-- Logs begin at Fri 2022-08-19 01:14:36 UTC, end at Fri 2022-08-19 02:37:53 UTC. -- Aug 19 02:10:37.060519 dv-osbrick-853457-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 02:10:37.070294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 02:10:37 2022] *** Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: nodename: dv-osbrick-853457-2-iscsi Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: machine: x86_64 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: clock source: unix Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: pcre jit disabled Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: detected number of CPU cores: 4 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: current working directory: / Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: detected binary path: /usr/bin/uwsgi-core Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: your processes number limit is 47680 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: your memory page size is 4096 bytes Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: detected max file descriptor number: 2048 Aug 19 02:10:37.073009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: lock engine: pthread robust mutexes Aug 19 02:10:37.073886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: thunder lock: enabled Aug 19 02:10:37.073886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 02:10:37.073886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 02:10:37.112456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: Python main interpreter initialized at 0x55bbf790b9c0 Aug 19 02:10:37.112456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: python threads support enabled Aug 19 02:10:37.112456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: your server socket listen backlog is limited to 100 connections Aug 19 02:10:37.112456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: your mercy for graceful operations on workers is 90 seconds Aug 19 02:10:37.112766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 02:10:37.112852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: *** Operational MODE: preforking *** Aug 19 02:10:37.113125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: *** uWSGI is running in multiple interpreter mode *** Aug 19 02:10:37.113125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: spawned uWSGI master process (pid: 81515) Aug 19 02:10:37.113316 dv-osbrick-853457-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 19 02:10:37.114064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: spawned uWSGI worker 1 (pid: 81527, cores: 1) Aug 19 02:10:37.118591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: spawned uWSGI worker 2 (pid: 81528, cores: 1) Aug 19 02:10:37.118591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81515]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 02:10:41.347910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:10:41.347910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: from cryptography.utils import int_from_bytes Aug 19 02:10:41.348686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:10:41.348686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: from cryptography.utils import int_from_bytes Aug 19 02:10:41.349165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:10:41.349165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: from cryptography.utils import int_from_bytes Aug 19 02:10:41.349614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 02:10:41.349614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: from cryptography.utils import int_from_bytes Aug 19 02:10:41.397420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 02:10:41.397608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 02:10:41.397806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] command line args: [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 02:10:41.398073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 02:10:41.398249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ================================================================================ {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 02:10:41.398436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 02:10:41.398521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] admin_token = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.398642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 02:10:41.398754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] config_dir = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.398839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] command line args: [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 02:10:41.398941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 02:10:41.399189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] config_source = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ================================================================================ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 02:10:41.399368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] debug = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] admin_token = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] config_dir = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.399868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.400002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.400102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.400194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] config_source = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.400285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.400395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] debug = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_config_append = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_dir = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.401918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_file = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_config_append = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_dir = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.402920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.403987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.404973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.405950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] publish_errors = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.406985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] publish_errors = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] standard_threads = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.407824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] use_journal = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] use_json = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] standard_threads = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] use_stderr = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] use_syslog = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.408895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.409565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] use_journal = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.409802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] use_json = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.409802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] use_stderr = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.410021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.410135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] use_syslog = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.410248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.410375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 02:10:41.410497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.410653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.410854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.410973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.411916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.412949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.413886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.414931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.415939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.416059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.416789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.416905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.417942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.418893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.419933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.420947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.421887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.422992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.423991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.424951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.425895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.426885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.427929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.428959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.429888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.430921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.431966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.432970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.433938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.external = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.434883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.password = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.435972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] auth.token = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.external = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.436920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.password = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.token = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.437979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.438947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.439976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.440928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.441976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.442971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.443900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.444948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.445986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.446903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.447962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.448966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.449907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.450914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.451961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.452899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.453928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.454888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.455940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.456993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.457919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.458996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.459946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.460997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.461928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.462804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.463412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.463536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.463652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.463767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.463882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.464959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.465890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.466975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.467905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] role.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] role.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.468962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.469967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] role.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] role.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.470918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.471995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.472928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.473998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.474113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.474228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.474342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.474465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.474465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.475362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.476435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.476557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.476674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.476805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.476924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.477983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.478099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.478223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.478340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.478456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.478669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.479887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.480944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.481995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.482954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.connection = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.483919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.484967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.485908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.486984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81528) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.487448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.488387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 02:10:41.488387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 02:10:41.512460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.512694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.512921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.514119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.514356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.514616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.521340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.522997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.550006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.550234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.551799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.552039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.604010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.604811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.652698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.652928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.654067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.654308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.808585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.808751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.808837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.808914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.808988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.809716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.832615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.832844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.832958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.833985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.834115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.834196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.834333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.834549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.845670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.846044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.858977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81528) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.859886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 02:10:41.876094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.876305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:10:41.876649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.876730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.876852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:10:41.876934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:10:41.877129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.877250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.877457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 02:10:41.877634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.877738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.877901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.878162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.878241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.878508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.878801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.887924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.888206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.888479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.888650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.888766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.888935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.889215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.889511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.895670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.896483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.898526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.898835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.899117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.899392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.899473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.899672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.899802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.899934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.900904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.901589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.901678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.901871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.901954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.902262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.902547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.902852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.924133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.925249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.925581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.925866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.926737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.927030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.930460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.930769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.931054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.932217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.932509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.932797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.937794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.938083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.939141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.939436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.942123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.942413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.942727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.943014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.943290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.943524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.943620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.943821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.943902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.944084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.944163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.944387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.944672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.944954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.945231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.945508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.961621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.961899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.963247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.963544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.965750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.967424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.968946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.969242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.970648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.970956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.973370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.975125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.976479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.978240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.979835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.980137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.980425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.980709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.980987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.981265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.981547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.981855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.982150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.982442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.982757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.983055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.997273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.997562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.997831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.998096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.999355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:41.999653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:41.999931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.000217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.004898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.006400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.006701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.007105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.008629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.008913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.009305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.009586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.010394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.010726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.011007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.012156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.012447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.012738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.013048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.013331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.022439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.022747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.023032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.023314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.023593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.023873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.024148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.024553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.024843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.025132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.025452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.025744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.026053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.026347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.039251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.041652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.042283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.044724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.045161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.046604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.047651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.048053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.048335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.048630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.049093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.050592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.050884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.051186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.055008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.056444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.058138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.059680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.059811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.060106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.060394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.060683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.062586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.062884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.063200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.063496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.068498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.068789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.069071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.071639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.071936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.072227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.076425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81528) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.076709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.076991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.077270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.077544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.077814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.078098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.078366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.078671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.078952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.079222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.079484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.079660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 02:10:42.079775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.079952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.080043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81528) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.080243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.080526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.080806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.081089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.081379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.081656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.081940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.082222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.082497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.082858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.083148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.083425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 02:10:42.113484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbf790b9c0 pid: 81528 (default app) Aug 19 02:10:42.116880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fa6-8285-41dd-9cf2-55a7c737ed5d None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:42.117166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fa6-8285-41dd-9cf2-55a7c737ed5d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:42.117340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbf790b9c0 pid: 81527 (default app) Aug 19 02:10:42.117422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fa6-8285-41dd-9cf2-55a7c737ed5d None None] PATH_INFO: `/v3` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:42.122130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Fri Aug 19 02:10:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:48.714029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:48.714545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:48.714643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:48.718825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:48.723844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:48.724272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:48.724417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:48.793754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: INFO dbcounter [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] Registered counter for database keystone Aug 19 02:10:48.812347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81528) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 02:10:48.818450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writer thread running {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 02:10:48.994495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG passlib.handlers.bcrypt [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81528) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 02:10:48.994866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG passlib.handlers.bcrypt [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81528) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 02:10:49.048968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:49.050592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:49.180264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 02:10:49.629931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:49.697916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: INFO dbcounter [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] Registered counter for database keystone Aug 19 02:10:49.719145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG oslo_db.sqlalchemy.engines [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 02:10:49.725162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writer thread running {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 02:10:49.841254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6cf7-3a0b-43b5-986f-a498534b3309 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:49.845439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:49.846065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:49.846341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:49.846637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:49.855021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:49.905037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 02:10:49.905324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81abdd-d816-4124-85bf-47ed1c7cafc3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:49.914458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Aug 19 02:10:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 02:10:49.920876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:49.935619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32fae-51aa-4cca-89c5-f6f8d3ca3484 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:49.939922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:49.941008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:49.941290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:49.941564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] PATH_INFO: `/v3/projects/4794a120bdce4ac9a7db206c3d083bb7` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:49.943154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] RBAC: Authorizing `identity:get_project(project_id=4794a120bdce4ac9a7db206c3d083bb7)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:49.995742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 02:10:49.996084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc3d9-7fd5-4405-ad89-c8c9355205fb admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:50.000510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Fri Aug 19 02:10:49 2022] GET /identity/v3/projects/4794a120bdce4ac9a7db206c3d083bb7 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:51.869412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6e232-4dfc-4913-9534-906455e82ee2 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:51.869928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6e232-4dfc-4913-9534-906455e82ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:51.870011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6e232-4dfc-4913-9534-906455e82ee2 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:51.874084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:10:51.879460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:51.879904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:51.879990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:51.899623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:51.901635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:51.909432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 02:10:52.177061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6e232-4dfc-4913-9534-906455e82ee2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:52.189562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6e232-4dfc-4913-9534-906455e82ee2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:52.193673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:52.194265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:52.194545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:52.194861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:52.202862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:52.204612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d640c2f-b5ba-498f-af40-b7033d75e375 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:52.213904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Aug 19 02:10:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:10:52.219208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:52.228130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95c7f4-80ef-45b8-9c52-1b19b55a8d62 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:52.232457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:52.233067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:52.233347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:52.233619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:52.234960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:52.236767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932e900-0ab8-40b6-b62d-f1a71609b781 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:52.238259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Fri Aug 19 02:10:52 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:54.168207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6330-32c3-4c26-906c-a381efa9ed1a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.168774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6330-32c3-4c26-906c-a381efa9ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.168774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6330-32c3-4c26-906c-a381efa9ed1a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.170085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:10:54.175371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.175793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.175925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.194135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:54.195339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:54.215826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ac38-0a67-447b-ac02-868af29a6adc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.216111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ac38-0a67-447b-ac02-868af29a6adc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.216386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ac38-0a67-447b-ac02-868af29a6adc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.217694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:10:54.222692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.222979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.223253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.265063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG passlib.handlers.bcrypt [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81527) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 02:10:54.265483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG passlib.handlers.bcrypt [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81527) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 02:10:54.276164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:10:54.311728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:54.313315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:54.419462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:10:54.542916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:54.566740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:54.648908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f043da-86ae-4ece-8fbe-62f00163ce31 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:54.682392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:54.682994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.683281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.683409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:54.683556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.694612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:10:54.703342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:10:54.704257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:10:54.705112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:10:54.710336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:54.785529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff702-247a-4885-9d7c-122344119b8b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:54.788469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:54.792913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:54.813255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7458-9a4f-4643-8ad7-49d48bec6db0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:54.824181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:54.825038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.825326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.825605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.846938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:54.847540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:54.847821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:54.848101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:54.848764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:10:54.849066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:54.850459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:54.862638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:10:54.868079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:54.892308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:54.893810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:54.964439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b30499-dd80-4fd7-ba6e-8c4b43b6f4be None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:54.989370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:10:54.994885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:54.997488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:54.999849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:55.000558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:55.000906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:55.001248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:55.002456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:55.003945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:55.005491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:10:54 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:10:55.010894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:55.024623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:55.092242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a789f-da27-4b99-ab67-76fceef36ca3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:55.109628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00480-f409-4f83-b454-dfe8c261b1b2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:55.125813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:55.126683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:55.126969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:55.127249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:55.143191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:55.143819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:55.144101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:55.144373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:55.145538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:55.146492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:55.146962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:55.147982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:55.148505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:10:55.154652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:10:55.166803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:10:55.167695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:10:55.169485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:10:55.169485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:10:55.169485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:10:55.169485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:10:55.173472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:55.232473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:55.237311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:55.257104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adb3ce-5c7d-483f-9039-e4a9a10076de None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:55.275963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedee7a-7fcb-4ee0-9ac3-9ca851baf69b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:55.289666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:55.290271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:55.290552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:55.290903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:55.291619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.domain.id=default, user.id=b7e755f06a714e6f8be16f18f3592f97) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:10:55.291925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:55.293354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b13322-f9b8-49a5-b0e6-abd06090fc61 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:55.299893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Aug 19 02:10:55 2022] GET /identity/v3/role_assignments?user.id=b7e755f06a714e6f8be16f18f3592f97&scope.domain.id=default&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:10:55.308326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:55.308959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:55.309240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:55.309515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:55.310179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:10:55.310482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:55.311961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c3b1d-3abc-41c2-bb3c-b1ab4778429b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:55.332001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:10:57.663447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9367-0393-4bcd-b839-6bcd4e52df20 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.663973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9367-0393-4bcd-b839-6bcd4e52df20 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.664053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9367-0393-4bcd-b839-6bcd4e52df20 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.665343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:57.676580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45ff7-7cba-40f1-9745-cda59d558e0d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.677057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45ff7-7cba-40f1-9745-cda59d558e0d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.677129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45ff7-7cba-40f1-9745-cda59d558e0d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.678456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 11/23] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:57.679919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8b3d-2d5c-4879-bc0b-aedb11378fad None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.680205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8b3d-2d5c-4879-bc0b-aedb11378fad None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.680479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8b3d-2d5c-4879-bc0b-aedb11378fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.684819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9d41-1490-4e02-b1d0-1e80ef1349ca None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.685106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9d41-1490-4e02-b1d0-1e80ef1349ca None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.685381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9d41-1490-4e02-b1d0-1e80ef1349ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.719922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3fda8b3d-2d5c-4879-bc0b-aedb11378fad None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:57.721361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3fda8b3d-2d5c-4879-bc0b-aedb11378fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:57.727869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cf5d9d41-1490-4e02-b1d0-1e80ef1349ca None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:57.729274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cf5d9d41-1490-4e02-b1d0-1e80ef1349ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:57.876683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 13/24] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:10:57.877957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39af44-a675-4704-84ef-d92175b2149a None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.878244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39af44-a675-4704-84ef-d92175b2149a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.878522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39af44-a675-4704-84ef-d92175b2149a None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.879782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 14/25] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:57.881000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 12/26] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:10:57.886746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036438d-ba76-4067-afc6-da559eef394c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:57.887034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036438d-ba76-4067-afc6-da559eef394c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:57.887318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036438d-ba76-4067-afc6-da559eef394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:57.915765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d036438d-ba76-4067-afc6-da559eef394c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:57.916877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d036438d-ba76-4067-afc6-da559eef394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:58.018712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 15/27] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:10:58.110135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21f0a-64ad-4453-b835-f9f4c96ecf79 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.110457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21f0a-64ad-4453-b835-f9f4c96ecf79 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.110724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe21f0a-64ad-4453-b835-f9f4c96ecf79 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.112307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 13/28] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:58.117365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.117863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.118355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.131386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:58.150596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:58.150596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:58.182104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21f0a-64ad-4453-b835-f9f4c96ecf79 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.281092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 16/29] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:10:58.297103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:58.371763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.408860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe21f0a-64ad-4453-b835-f9f4c96ecf79 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:58.475947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:58.476520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.476800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.477073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.505402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:10:58.511862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:10:58.512686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 14/30] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:10:58.513849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.605334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d0a20-eb4f-458a-93a3-df29456db10f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:58.656806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e529d3-6177-44e7-bb55-232c9c6a7b4f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:58.666632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:58.678026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:58.679353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.679802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.680217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.683595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:58.693386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:58.695261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:58.700308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:58.700924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.701209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.701487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.702152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:58.704100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:10:58.715960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:10:58.717050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:10:58.717949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:10:58.717949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:10:58.717949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:10:58.719488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 17/31] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:10:58.720526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.825759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439ac1-796e-4ea5-af34-e236152f6827 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:58.829527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 15/32] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 19 02:10:58 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:10:58.835485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.868001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:58.869014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.869449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.869864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.870773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:10:58.871235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:58.873042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09141cf8-9cf6-48d7-b43a-c83d99253f15 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:58.883611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 18/33] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:58.885874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9a97-06b3-4cf9-bbc3-d148a07631da None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:58.886319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9a97-06b3-4cf9-bbc3-d148a07631da None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:58.886927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b9a97-06b3-4cf9-bbc3-d148a07631da None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:58.888849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 19/34] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:58.889877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9a97-06b3-4cf9-bbc3-d148a07631da None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:58.963088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748fbb4-227f-4059-9fe1-2facc0583420 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:58.964077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:59.006946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.007983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.008461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.008926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.010444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.012208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.030727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 19 02:10:58 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:10:59.031633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:59.032187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b9a97-06b3-4cf9-bbc3-d148a07631da None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.076580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:59.084748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.086036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.086544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.087109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.088898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:10:59.090399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.092225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2358-53dc-420f-9910-9b9e2eebf151 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.116780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 20/36] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:59.118877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.119366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.119834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.145150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:59.146953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:59.190442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6fae-d0bc-4fb1-9da1-66a8b01d317f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.235310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 21/37] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:10:59.235877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.236543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.236885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.237130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:59.237226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.238822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.240358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.242963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 17/38] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:10:59 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:59.251721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:59.282622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:59.348409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddd091-ca85-4710-913b-e79008de4ca4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.363200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:59.372636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5472f-6bd2-440e-9e32-0c8e2f88cb64 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.396342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.397229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.397844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.398305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.399289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.401113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d317e7-6d84-4486-b0f9-a1bf7b50333e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.409701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.410344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.410659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.410939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.412180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.413746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.415762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 18/39] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:10:59.421053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:59.523589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b532a-8029-4b59-addb-4ad7cd89c379 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.561226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.561919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.562206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.562489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] PATH_INFO: `/v3/domains/default/users/b7e755f06a714e6f8be16f18f3592f97/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.564557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b7e755f06a714e6f8be16f18f3592f97, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.566048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049d58-408b-4eb6-af08-43136ce77314 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.581621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 19/40] 10.222.0.45 () {58 vars in 1361 bytes} [Fri Aug 19 02:10:59 2022] PUT /identity/v3/domains/default/users/b7e755f06a714e6f8be16f18f3592f97/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:10:59.583515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7d4-4371-425e-bfcb-8425614aa9b9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.584075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7d4-4371-425e-bfcb-8425614aa9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.584363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7d4-4371-425e-bfcb-8425614aa9b9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.585928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 20/41] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:10:59.587731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc7d4-4371-425e-bfcb-8425614aa9b9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:10:59.617835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:10:59.666606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:10:59 2022] POST /identity/v3/projects => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:10:59.666606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.666606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.666606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.686114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:10:59.687938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:10:59.722209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc7d4-4371-425e-bfcb-8425614aa9b9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:10:59.769466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:10:59.770097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:10:59.770381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:10:59.770747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:10:59.771379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:10:59.772759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:10:59.772881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:10:59.797657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 21/44] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 19 02:10:59 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:00.045649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:00.066514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:00.143265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d13aa8-9ab6-467c-b83b-066b8d40ae9b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:00.177313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:00.177953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:00.178260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:00.178518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:00.179658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:00.181263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f307c9-af95-4590-ae18-be2f936e6ca1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:00.182865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:00.188388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:00.267653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:00.286247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282e0e-16cb-44bd-bfbc-c8b288e5806f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:00.319124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:00.319669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:00.319951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:00.320229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:00.320867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:00.322890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f90f9-da4d-4da7-a857-cfa07afedbc0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:00.351369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:11:00 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:01.536766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5c42-6203-4813-ba34-6bedd7ee22e7 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:01.537252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5c42-6203-4813-ba34-6bedd7ee22e7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:01.537252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc5c42-6203-4813-ba34-6bedd7ee22e7 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:01.538759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:01.544439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:01.544825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:01.545009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:01.563310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:01.564816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:01.630093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:01.902792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5c42-6203-4813-ba34-6bedd7ee22e7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:01.990902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:02.004878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc5c42-6203-4813-ba34-6bedd7ee22e7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.037752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.038383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.038703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.038985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.049504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f719f93b-9885-4fd1-b051-ad325aaeaaf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:02.054305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:02.055199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:02.056009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:02.061912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.226442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:02.235254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc469-b320-43c1-936d-8efbcd3c211b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.235730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc469-b320-43c1-936d-8efbcd3c211b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.236015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc469-b320-43c1-936d-8efbcd3c211b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.237374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 27/50] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:02.242413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.242737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.243022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.261405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:02.262633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:02.266428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e5d8-e7fe-4994-a621-c92b5d82b663 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.300050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.300659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.300942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.301217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.301880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:02.302184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.303590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.315015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 24/51] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:02.320696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.332520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 28/52] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:02.418978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a3d0-3392-44a7-8aa4-53e5d1613ad1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.446890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:02.457557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.458188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.458467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.459041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.460187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.461630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.463770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 25/53] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:02 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:02.469344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.545368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:02.566648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a583f9f-6769-4e54-94d4-0aecbf697c44 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.599850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.600477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.600761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.601036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.602138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.603645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.606235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 29/54] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:02.606341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.610706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.702899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c6910-eaff-4859-8446-72ba1a35eb25 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.706172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fb781-4a86-41cc-aaec-cb529ccb8857 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.738213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.738879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.739163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.739439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.739542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.740134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.740414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.740539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.740689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.741403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.domain.id=default, user.id=b7e755f06a714e6f8be16f18f3592f97) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:02.741711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.741983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.743176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823c13-5cba-4954-b61b-9849e3e7fad2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.743582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 26/55] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:02.748996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:02.749104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 30/56] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Aug 19 02:11:02 2022] GET /identity/v3/role_assignments?user.id=b7e755f06a714e6f8be16f18f3592f97&scope.domain.id=default&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:02.814943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:02.856243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c762-edf0-4c95-9df2-c3d690e317ca None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:02.890449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:02.891094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:02.891375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:02.891649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:02.892303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:02.893773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731f0bb-871c-425d-95ec-36436ffd12f2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:02.921923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 27/57] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Aug 19 02:11:02 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:11:04.808444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d920-8fa4-4390-a135-f8cee869605e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:04.808959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d920-8fa4-4390-a135-f8cee869605e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:04.809045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d920-8fa4-4390-a135-f8cee869605e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:04.810353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 31/58] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:04.815526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:04.815910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:04.816086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:04.839552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:04.840728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:04.903021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:05.176091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1d920-8fa4-4390-a135-f8cee869605e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:05.189421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:05.275750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1d920-8fa4-4390-a135-f8cee869605e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:05.307756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:05.308376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:05.308661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:05.308936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:05.310042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:05.311516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487f961-8aa8-43e7-8697-727a8373bdae None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:05.313075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 32/60] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:05.318517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:05.362877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:05.414799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbc332-e794-47b8-8c95-a9ef4c20e117 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:05.447145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:05.447690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:05.447978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:05.448256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:05.448907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:05.450335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fd23c-5285-470e-a869-424ffb3eec9a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:05.475909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 29/61] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:05 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:08.434965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570242-c370-490e-97bb-d849ca51f4ce None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.435959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570242-c370-490e-97bb-d849ca51f4ce None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.436446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570242-c370-490e-97bb-d849ca51f4ce None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.437999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 33/62] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:08.443178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452b-c3e2-42f0-aae3-a72dfc91c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.443969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452b-c3e2-42f0-aae3-a72dfc91c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.444466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452b-c3e2-42f0-aae3-a72dfc91c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.471562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e128452b-c3e2-42f0-aae3-a72dfc91c1c4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:08.473089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e128452b-c3e2-42f0-aae3-a72dfc91c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:08.560846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 30/63] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:08.586862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb68a-5851-419a-b69d-9edebd4f5d39 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.587543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb68a-5851-419a-b69d-9edebd4f5d39 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.588499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb68a-5851-419a-b69d-9edebd4f5d39 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.590045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 34/64] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:08.595368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd5ce5-5365-4800-a4c0-cfa7f0dede86 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.595889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd5ce5-5365-4800-a4c0-cfa7f0dede86 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.596363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd5ce5-5365-4800-a4c0-cfa7f0dede86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.623721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3edd5ce5-5365-4800-a4c0-cfa7f0dede86 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:08.625219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3edd5ce5-5365-4800-a4c0-cfa7f0dede86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:08.662131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:08.724942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 31/65] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:08.816249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e450f-70b2-4611-abf5-b9494f5ebb5c None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.816903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e450f-70b2-4611-abf5-b9494f5ebb5c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.817391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e450f-70b2-4611-abf5-b9494f5ebb5c None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.818993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 35/66] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:08.825096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706c27-e9aa-4bb7-9d7c-e7030229e883 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:08.825388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706c27-e9aa-4bb7-9d7c-e7030229e883 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:08.825672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706c27-e9aa-4bb7-9d7c-e7030229e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:08.850469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e450f-70b2-4611-abf5-b9494f5ebb5c None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:08.857831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-23706c27-e9aa-4bb7-9d7c-e7030229e883 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:08.859075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-23706c27-e9aa-4bb7-9d7c-e7030229e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:08.975910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:08.980322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 32/67] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:09.017456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e450f-70b2-4611-abf5-b9494f5ebb5c None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.026800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9127-770a-4b10-95d6-df70f40fb5da None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.027280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9127-770a-4b10-95d6-df70f40fb5da None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.027703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9127-770a-4b10-95d6-df70f40fb5da None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.029189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 33/68] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:09.035424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.035868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.036292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.055024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:09.057008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:09.066123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.066785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.067072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.067352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.078728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:09.083802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:09.084904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:09.085692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 36/69] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:09.086312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.137965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:09.139155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.163231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.210014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883366b5-752e-4a22-84ee-9da79ecb1b17 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.254176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76854c79-de8d-4a50-a7d6-26fc002eeb65 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.254704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.255513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.256111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.256544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.265921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.270693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-736bdb6b-bb28-4292-bd51-03698f89877a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:09.277839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:09.278905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:09.279824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:09.282134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 37/71] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:09.283658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b09d9-be01-47a3-95e3-4b7b57802ba0 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.284075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b09d9-be01-47a3-95e3-4b7b57802ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.284473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b09d9-be01-47a3-95e3-4b7b57802ba0 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.285822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 38/72] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:09.288887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b09d9-be01-47a3-95e3-4b7b57802ba0 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.302200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.303261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.303742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.304246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.305274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:09.305774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.307560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b0c1-8424-4e30-8830-242d0e20f891 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.317028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 35/73] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:09.318770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.319375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.319871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.339809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:09.341005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:09.401007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b09d9-be01-47a3-95e3-4b7b57802ba0 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.414595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:09.414595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.427026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.445225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.445844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.446126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.446401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.447644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:09.447948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.449482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.458085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 39/75] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:09.458821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.520508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.522363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4254b0-7b53-4c23-b92f-dcf3b8187a16 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.557445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.558076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.558364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.558674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.566809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1298e0-211a-43d5-9239-a17a7655f9fb None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.573840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.575330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.576956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 37/76] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:09.581532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.612207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.612844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.613129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.613406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.626587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:09.633815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:09.635231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:09.635995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 40/77] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:09.636676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.657700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.691614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a595b-98a0-49a4-9c48-f3131e9a95b1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.726533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.727192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.727475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.727753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.737622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:09.742693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7261-b85c-4e26-9ec3-18b65e6f1937 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:09.742809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:09.744144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:09.745134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.765254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.779014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.779581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.779866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.780146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.781284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.782782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.784639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 41/79] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:09.785402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.842774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc231a-bb0f-4d25-85f8-7d8a15650032 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.870005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:09.876651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.877257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.877536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.877813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.887427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edbbb-54ed-4fd7-be1d-e9abacc0cf61 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:09.921174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:09.921780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:09.922065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:09.922346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:09.923039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:09.923346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.924719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.932873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 42/80] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:09.934981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:09.943848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:09.945315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:09.982862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.032172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052b41b-a4b6-4359-875b-ceb6a4f4adda None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.042111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:10.047554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.065511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.066134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.066417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.066725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.067833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.069276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.070856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 43/82] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.075979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.076816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.146130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7b2b4-96fe-4444-9a63-fc40f6d7f925 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.172434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8fbe-47a3-4562-b0f4-261f2b53e86d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.179274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.179956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.180238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.180513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.181837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:10.182144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.183567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.190131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.191974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 40/83] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.192929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.210107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.210949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.211231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.211707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.277780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.279712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.282661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.295161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e6bba-37f5-4edd-9caa-ee917de0e1d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.327913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.328540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.328827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.329106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.330261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.331733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.338366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 41/84] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.338366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.381238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 44/85] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:10.385945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.399180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.432405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578eb2-a960-42c2-9486-a5d5bcab781e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.465092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.465723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.466005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.466282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.467441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.468886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.470502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 42/86] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.471292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.482981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4dc9-9116-40d6-b070-c5f8ae1c339f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.502861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.515799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.516417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.516776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.517193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.518338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.521133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.552476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 45/87] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:10 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:10.553236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.581048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da5ac9-255a-4594-9bfb-fe5bea421b69 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.625428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.626787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.627361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.627649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.628916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.631429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.633571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 43/88] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.634835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.640608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.676752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262fba-aa5e-4958-87cb-19571d57dd64 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.717521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.718152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.718436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.718753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.743530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.752760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1718ad-2f50-4a51-ac3a-39d78f698f35 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.791738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.792378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.792674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.792929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.794060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.795856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.798779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 44/89] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.799573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.807495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.809300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.901638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:10.930647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0e70b-f9cc-4a0a-b6da-521c141ecd77 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:10.939003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 46/90] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:10.940020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:10.968378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:10.969339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:10.969769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:10.970190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:10.971238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:10.971711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:10.973461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:10.982286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 45/91] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=3a794b68c0934063ac3400ead0e17439 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:10.983414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:11.017465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:11.066329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4d4a-652d-4e95-a355-38cc42a0701b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.105810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.106736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.107216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.107638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.111342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad01d-1aa5-417b-95bf-7d3d53748a0e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.151587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.152371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.153603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.153998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.154911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=b7e755f06a714e6f8be16f18f3592f97) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:11.155331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.156926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.163059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:11.166609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 46/92] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/role_assignments?user.id=b7e755f06a714e6f8be16f18f3592f97&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:11.166609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:11.223481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.224990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.272304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:11.281984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33697a6b-817f-4df7-adb0-4005921c6146 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.323047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.323630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.323915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.324192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.325443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.326972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.329014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 47/93] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:11 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:11.335344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:11.398179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 47/94] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:11.407659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:11.445753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c0ff-63b0-488b-9b77-e5af4c131f4c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.481713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.482329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.482634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.482918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.483658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:11.483970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.485415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.491591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 48/95] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:11 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=072aae4a92604daca4ad778a1b442950 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:11.542250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:11.557013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e452-502d-4df7-93c5-0b17c9aee346 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.607292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.607862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.608144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.608421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] PATH_INFO: `/v3/projects/3391117e441d414aa19e85adb725359c` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.609632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] RBAC: Authorizing `identity:get_project(project_id=3391117e441d414aa19e85adb725359c)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.611122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64a1a0-290e-4db3-97bc-d44a98be5b3a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.612892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 48/96] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:11 2022] GET /identity/v3/projects/3391117e441d414aa19e85adb725359c => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:11.618927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:11.649459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:11.741697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ae4f-6e9d-4a23-bc3a-0e1420a48258 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:11.778663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:11.779254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:11.779540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:11.779821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:11.780552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=3391117e441d414aa19e85adb725359c, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:11.780864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:11.782298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b5f50-fedf-414a-b556-ce6248f75bd4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:11.788357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 49/97] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:11 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=3391117e441d414aa19e85adb725359c&role.id=3a794b68c0934063ac3400ead0e17439 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:13.481486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e050f8-405b-4290-82cf-71a3945019ef None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.481982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e050f8-405b-4290-82cf-71a3945019ef None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.481982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e050f8-405b-4290-82cf-71a3945019ef None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.483597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 49/98] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:13.504283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a989a-d794-4c95-b571-71bc903fcdf2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.504877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a989a-d794-4c95-b571-71bc903fcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.504877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a989a-d794-4c95-b571-71bc903fcdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.531575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5b7a989a-d794-4c95-b571-71bc903fcdf2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:13.532800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5b7a989a-d794-4c95-b571-71bc903fcdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:13.595056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365cb-490b-426f-93ca-4365a9ca1407 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.595703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365cb-490b-426f-93ca-4365a9ca1407 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.596184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365cb-490b-426f-93ca-4365a9ca1407 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.597979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 50/99] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:13.603287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.603810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.604310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.627103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:13.628310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:13.631569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 50/100] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:13.671200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40330c-736f-412d-90a9-fadc90455c48 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.671487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40330c-736f-412d-90a9-fadc90455c48 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.671767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40330c-736f-412d-90a9-fadc90455c48 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.673117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 51/101] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:13.678105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:13.678387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:13.678704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:13.708227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:13.709690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:13.735495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 51/102] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:13.737608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:13.832815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 52/103] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:14.046544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.094414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.133738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.171158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db06b-dd96-4a6a-b031-542bf139c99d None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.213477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.214477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.215019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.215488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.216818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:14.218490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:14.220312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 52/104] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:14.226032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04804f-9429-44f5-ba4f-0a5fdd8c7553 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.240447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.273341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.275811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.278054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.278537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.304307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:14.309680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:14.310513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:14.311303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:14.313840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 53/105] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:14.323042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.340887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.386217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9aab-4750-40be-ae4a-90daca3aaa03 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.430521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.431200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.431520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.432034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.433337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:14.435144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:14.451604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.469008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e35fd-7bad-4989-9dbb-c4300e3a07ef None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.469274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 53/106] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:11:14 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:14.470082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.518447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.519823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.520282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.520729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.534075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-894170f0-3b0b-49ca-b021-6189e78d8789 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:14.539487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:14.540978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:14.541757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:14.544244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 54/107] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:14.545777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec312-599a-4a45-b33f-9a971b66e041 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.546293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec312-599a-4a45-b33f-9a971b66e041 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.546773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ec312-599a-4a45-b33f-9a971b66e041 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.548425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 55/108] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:14.549731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2496e2-3020-44ff-959b-d476a67ad12e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.550192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2496e2-3020-44ff-959b-d476a67ad12e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.550756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2496e2-3020-44ff-959b-d476a67ad12e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.552907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 56/109] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:14.558212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2496e2-3020-44ff-959b-d476a67ad12e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.601547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c1a9-e71a-4870-81ee-feb2e4cf58d4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.636429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.645971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.646723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.647006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.647408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.648111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:14.648421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:14.650516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7ad36-05cc-4d21-8208-b5fc5f4fee86 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:14.659760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 54/110] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:14.660812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.661113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.661523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.679371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2496e2-3020-44ff-959b-d476a67ad12e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.685446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:14.686724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:14.725027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:14.725766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.726051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.726323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.727101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:14.727402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:14.728805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a404d-a5dd-4a01-91de-c01905d9aa46 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:14.737918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 57/111] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:14.742647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5269-a633-4ce9-a2d8-755426a21fd6 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.742647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5269-a633-4ce9-a2d8-755426a21fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.742647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5269-a633-4ce9-a2d8-755426a21fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.750430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.758905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-975f5269-a633-4ce9-a2d8-755426a21fd6 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:14.760944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-975f5269-a633-4ce9-a2d8-755426a21fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:14.770828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 55/112] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:14.771832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.851299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 58/113] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:14.852874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fb8a-d3b9-4e68-bed4-fb2a53787f98 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:14.853353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fb8a-d3b9-4e68-bed4-fb2a53787f98 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:14.853775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fb8a-d3b9-4e68-bed4-fb2a53787f98 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:14.855229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 59/114] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:14.856061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fb8a-d3b9-4e68-bed4-fb2a53787f98 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:14.927431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:14.928767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d09c-8786-4099-9477-f285ecb27e1b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:14.974504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fb8a-d3b9-4e68-bed4-fb2a53787f98 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.001088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.001732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.002012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.002286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.003479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.005047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276be984-e901-44ea-8a68-706e4bd86426 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.007075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 56/115] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:15.008356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.008675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.008906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.026184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.027184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.027470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.029153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] PATH_INFO: `/v3/users/4837bdb321ea457b863b803b554243c5` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.048243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:15.050751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:15.055789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] RBAC: Authorizing `identity:get_user(user_id=4837bdb321ea457b863b803b554243c5)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.058981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.063727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 60/116] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:14 2022] GET /identity/v3/users/4837bdb321ea457b863b803b554243c5 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:15.065310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.123927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.152812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 57/117] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:15.154008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.210494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5c23-0c7c-4588-a48d-d028b89adae6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.231214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.252109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.252999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.253488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.254160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.256101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.258246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.261544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 61/118] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:15.262483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.299077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e880e8f-bfdb-4b5b-9d30-0cb79d9cd455 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.344371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.345078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.345668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.346019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.386832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc112d-d4ed-42bc-95ad-30b853226dd2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.413763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.431851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.432865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.433219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.433568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.439106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.440792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.447299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:15.453186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:15.454048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:15.454860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 62/119] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:15.455500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.509171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.550933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 58/120] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:15.552038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.569329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c50b3-d482-42d5-9421-e78c708e3c1e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.606708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.607507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.607795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.608356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.621953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:15.627875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:15.628706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:15.629488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:15.630768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 63/121] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:15.631387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.646685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.659342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc256c-deef-43f0-b748-5a4c34f9d581 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.697915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.698602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.698887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.699171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/users/c645bfdb45ef433289f7ec009efccb8d/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.701067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, user_id=c645bfdb45ef433289f7ec009efccb8d, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.702518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.719265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 59/122] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:15 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/users/c645bfdb45ef433289f7ec009efccb8d/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:15.719857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.747856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd7347-9762-437f-a652-460a4ec30bf8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.757184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.797426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.798098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.798386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.798699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.815930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:15.822470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:15.823482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:15.824453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 64/123] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:15.825754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.856346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317414-1871-4e74-8bbf-00666e534ee9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.903625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.904452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.904743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.905028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.905709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:15.906026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.908141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:15.923561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 60/124] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:15.924425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:15.931760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:15.956760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0271b9-01aa-46b8-901b-0489ce591741 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:15.995678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:15.996410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:15.996702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:15.996983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:15.998130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:15.999847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.001540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 65/125] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.002321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.034976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b9dd-0072-4b3f-8585-02ae6df168ce None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.046867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.070922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.072269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.072562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.073227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.074168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:16.074479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.076428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.088125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 61/126] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.089570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.121903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c8d4a-fc3e-468d-a994-70736a3b45a8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.166875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.167421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.167708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.167992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.168665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:16.168973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.169474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.171660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.184607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 66/127] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.189872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.215472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26555805-c461-4362-beba-73dcd8184c36 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.257838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.259639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.260225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.260960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.262600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.264958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.266943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 62/128] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.268355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.306497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.313802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46867c4-2dca-4392-a584-5866598ffd6b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.360470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.361117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.361672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.361965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.362747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=4837bdb321ea457b863b803b554243c5) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:16.363063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.365712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.372741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 67/129] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/role_assignments?user.id=4837bdb321ea457b863b803b554243c5&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=c7af1985884c4d939727628fc6a7963e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.373619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.400845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ba69-8b04-4043-b5d7-ea6c7ee0dffa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.441830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.442854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.443354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.443771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.445061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.447447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.449215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 63/130] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.450391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.462606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.569287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809dc1-fcbe-44da-b5c5-6d0b89afcb58 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.588307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed926-55fc-4dac-b2f4-b045f30e1a99 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.605809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.606884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.607177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.607456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.608611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.610823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.613462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 68/131] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.614258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.629283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.630135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.630561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.630968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.632195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.633915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e704ef-ba8a-405b-8965-6161e5ab9996 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.636672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 64/132] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.638235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d90f-5957-4882-ae61-dd42a77b52b2 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.638657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d90f-5957-4882-ae61-dd42a77b52b2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.639072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542d90f-5957-4882-ae61-dd42a77b52b2 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.640532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 65/133] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:16.645318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542d90f-5957-4882-ae61-dd42a77b52b2 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.647265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.732044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.735434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782769-dd46-4eba-8d48-ddb7e62ab590 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.774277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542d90f-5957-4882-ae61-dd42a77b52b2 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.781565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.782652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.782946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.783226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] PATH_INFO: `/v3/projects/3391117e441d414aa19e85adb725359c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.784370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] RBAC: Authorizing `identity:get_project(project_id=3391117e441d414aa19e85adb725359c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.786188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.788689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 69/134] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/projects/3391117e441d414aa19e85adb725359c => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.789229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.824731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.825381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.825710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.826021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.827907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.830055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3e4aa-8e61-49e1-a7de-31fe7df0ae03 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:16.836908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 66/135] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:16 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:16.836908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.836908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.836908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.858804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:16.860316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:16.910616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:16.920992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4a30-df87-4a9a-98fc-de3edf063af0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:16.953933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 67/136] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:16.955408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:16.980501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:16.981206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:16.981487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:16.981765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/users/c645bfdb45ef433289f7ec009efccb8d/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:16.984234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, user_id=c645bfdb45ef433289f7ec009efccb8d, role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:16.985712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:17.015132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 70/137] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:16 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/users/c645bfdb45ef433289f7ec009efccb8d/roles/072aae4a92604daca4ad778a1b442950 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:17.018205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:17.036491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:17.081533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3583a-6c34-430a-9400-aff41b7f64b2 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:17.127411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:17.128379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:17.128757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:17.129132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] PATH_INFO: `/v3/projects/3391117e441d414aa19e85adb725359c/users/c645bfdb45ef433289f7ec009efccb8d/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:17.131258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] RBAC: Authorizing `identity:create_grant(project_id=3391117e441d414aa19e85adb725359c, user_id=c645bfdb45ef433289f7ec009efccb8d, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:17.133633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:17.151032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 68/138] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:16 2022] PUT /identity/v3/projects/3391117e441d414aa19e85adb725359c/users/c645bfdb45ef433289f7ec009efccb8d/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:17.197126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4583e-93fc-4212-94ee-1c34bbf0dfbd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:17.253441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:17.254060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:17.254346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:17.254654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/users/b7e755f06a714e6f8be16f18f3592f97/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:17.260349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, user_id=b7e755f06a714e6f8be16f18f3592f97, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:17.261867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:17.283530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 71/139] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:17 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/users/b7e755f06a714e6f8be16f18f3592f97/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:17.357835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:17.488266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b8cf-c390-4e54-a51a-be0f237813cf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:17.516979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:17.528978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:17.529637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:17.529934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:17.530221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:17.532069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:17.533835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dbe95-6eae-4b69-b62c-97b4f8dcb6f1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:17.536017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 69/140] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:17.543439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:17.578815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:17.722253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124369f-3e43-4c3a-8c08-be678bbe8968 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:17.779786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:17.780770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:17.781239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:17.781731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:17.782596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:17.784363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0823d-5e17-4d88-a3ea-4d9adeac6330 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:17.820695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 72/141] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:17 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:18.271631 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c07-d82e-4deb-8fce-d534dadf9085 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:18.272144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c07-d82e-4deb-8fce-d534dadf9085 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:18.272216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99c07-d82e-4deb-8fce-d534dadf9085 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:18.273817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 70/142] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:18.288000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f560-3231-4ad1-8dd5-3407399cf9c2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:18.288289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f560-3231-4ad1-8dd5-3407399cf9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:18.288573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f560-3231-4ad1-8dd5-3407399cf9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:18.312871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6d69f560-3231-4ad1-8dd5-3407399cf9c2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:18.314068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6d69f560-3231-4ad1-8dd5-3407399cf9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:18.392724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 73/143] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:18.683671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99c07-d82e-4deb-8fce-d534dadf9085 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:18.694026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a7b6-9fa9-42a0-af17-8dc8c837e1bc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:18.694333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a7b6-9fa9-42a0-af17-8dc8c837e1bc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:18.694590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a7b6-9fa9-42a0-af17-8dc8c837e1bc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:18.698395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 74/144] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:18.701999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:18.702501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:18.702835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:18.715003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:18.736360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:18.737539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:18.842350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99c07-d82e-4deb-8fce-d534dadf9085 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:18.868104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 75/145] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:18.889883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:18.890592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:18.890896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:18.891173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:18.902681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:18.908515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:18.909331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:18.910509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 71/146] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:18.916052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.051110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7fb7-9164-4125-8f69-f4efbd7bc231 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.088681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.093698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.094319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.094656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.094904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.099328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:19.099645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.101023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.110019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 76/147] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:19.115722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.198078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.210004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.255122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f40f96-50e8-4837-8038-c42e375d2071 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.295551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.296195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.296456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.296729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.297865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.299970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.301903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 72/148] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:19.309376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.436307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc812-216c-46e3-b2aa-4ad1fc205913 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.457792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ce14-4234-44c3-80fa-1606b8fe4073 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.476637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.477278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.477556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.478383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.492675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:19.498061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:19.498946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:19.499711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:19.500805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 77/149] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:19.501375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.505978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.511951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.512585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.512870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.513148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.566526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.607982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.609478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.615410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ebdc0-dc7b-433c-8a3d-359e79c2a0e8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.651679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.652538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.652954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.653359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.654166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:19.654620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.656116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.665132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 78/150] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:19.670768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.742098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 73/151] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:19.763001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.784651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d889-2b73-4415-999e-47b7ab2f4bec None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.802477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.804418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:19.823331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.824198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.824612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.825018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] PATH_INFO: `/v3/users/4837bdb321ea457b863b803b554243c5` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.826283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] RBAC: Authorizing `identity:get_user(user_id=4837bdb321ea457b863b803b554243c5)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.827890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.829635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 79/152] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/users/4837bdb321ea457b863b803b554243c5 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:19.835477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:19.899662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8d6d2-88c4-46dd-835a-fb6617175d1a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.950117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f808fa-9e16-495b-a881-8e4edb6c26bd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:19.979853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:19.980516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:19.980802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:19.981081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:19.982234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:19.983740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:19.986498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 74/153] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:19.995065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:20.015524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:20.016495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.016912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.017391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.018690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:20.020541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:20.026591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 80/154] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:20.029558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:20.108177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:20.159782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:20.172391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ce42b-c010-4539-909d-b86ddf474cce None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:20.180753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768b58e-bb63-48e0-973d-e9337c6539bf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:20.212743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:20.213761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.214222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.214664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/users/4837bdb321ea457b863b803b554243c5/roles/c7af1985884c4d939727628fc6a7963e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.217025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, user_id=4837bdb321ea457b863b803b554243c5, role_id=c7af1985884c4d939727628fc6a7963e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:20.218661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b35fa-3b21-4608-a12e-3581c0f68bb3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:20.243160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 81/155] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:20 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/users/4837bdb321ea457b863b803b554243c5/roles/c7af1985884c4d939727628fc6a7963e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:20.248919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:20.249717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.250132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.250545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.251625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:20.252113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:20.253703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc2ab-eac8-4e21-a5a4-a45998036249 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:20.263410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 75/156] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:19 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=3a794b68c0934063ac3400ead0e17439 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:20.427330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e2ae-5b68-4f80-8a13-d7ff4634701d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.427872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e2ae-5b68-4f80-8a13-d7ff4634701d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.428282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e2ae-5b68-4f80-8a13-d7ff4634701d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.430121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 82/157] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:20.435626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbf52-0a01-4777-88c1-17eeaf7f6a0b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.436440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbf52-0a01-4777-88c1-17eeaf7f6a0b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.436879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbf52-0a01-4777-88c1-17eeaf7f6a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.458960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c63bbf52-0a01-4777-88c1-17eeaf7f6a0b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:20.460840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c63bbf52-0a01-4777-88c1-17eeaf7f6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:20.539291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:20.812198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b593e9-5945-4d31-9c61-e6ed0fdf5141 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.813024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b593e9-5945-4d31-9c61-e6ed0fdf5141 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.813452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b593e9-5945-4d31-9c61-e6ed0fdf5141 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.815264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 83/159] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:20.820266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.820704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.821114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.847549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:20.849107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:20.867334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de6d0-b3ad-44ad-8b96-0818bc1ba0b4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.867762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de6d0-b3ad-44ad-8b96-0818bc1ba0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.868163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de6d0-b3ad-44ad-8b96-0818bc1ba0b4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.869910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 84/160] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:20.876494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:20.876893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:20.877265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:20.907783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:20.909113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:20.933252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 77/161] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:21.003121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 85/162] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:21.148053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:21.166299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:21.259829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc815ec-83ff-4478-a802-f575e66a0b41 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:21.297965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:21.298632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:21.298918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:21.299191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:21.310325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:21.315005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:21.316066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:21.316962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 78/163] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:21.327658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:21.384479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:21.461853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94c42-2405-4838-873e-67287e1dbc9e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:21.501987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:21.502635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:21.502917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:21.503193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:21.503869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:21.504171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:21.505555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:21.508689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:21.516699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 86/164] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:21.547904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:21.713475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:21.742405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a9f7f-dbcb-468c-b134-88af80225936 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:21.753817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:21.777203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3758-4901-4a4e-912c-66957360794d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:21.823893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:21.824573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:21.824823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:21.825099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:21.827609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:21.829066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:21.830686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 87/165] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:21.831457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:21.844212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:21.844864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:21.845142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:21.845416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:21.862456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:21.867238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:21.868096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:21.868906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 79/166] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:21.869766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.026040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184e42-69ed-413c-8bae-b179e643f199 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.066558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca570ae-2699-4a17-a1d7-a9cbf78823ac None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.076225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.076860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.077143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.077418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.098907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.120124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.120766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.121048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.121325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.132070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:22.137986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:22.138905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:22.139670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 88/167] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:22.140384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.182525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.218542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.220602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12b8f-f3b4-4839-83e6-aed9fde1559e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.253744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e19ab-a415-4320-9a16-bfe8f8cf6317 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.289900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.290838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.291262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.291679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.292510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:22.292954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.294477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09011d-9c0f-442a-8b41-a3bb5abdca44 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.306747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 89/168] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.308290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab636f9-86d0-4311-94f6-32ee899c666c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.308755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab636f9-86d0-4311-94f6-32ee899c666c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.309173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab636f9-86d0-4311-94f6-32ee899c666c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.310713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 90/169] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:22.311543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab636f9-86d0-4311-94f6-32ee899c666c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.428001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 80/170] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:22.429497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.431636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.432055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.458008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:22.459834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:22.486932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.498665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab636f9-86d0-4311-94f6-32ee899c666c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.515039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.564339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.564871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.565157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.565433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.566102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:22.566403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.567819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.583852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 81/171] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:22.584973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 91/172] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.588031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.751763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e387-3cd0-4fe3-8ba1-b13816bbaebc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.770374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eabaa-e790-4b78-a47f-193229fb5ad4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.797292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.798340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.798858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.799342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.800675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.802357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.804517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 92/173] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.806445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.807789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.808488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.808829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.809304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] PATH_INFO: `/v3/users/b7e755f06a714e6f8be16f18f3592f97` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.810504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=b7e755f06a714e6f8be16f18f3592f97)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.812491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8eb4b-47e2-4de3-bbe5-05aa9f4f9cc6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.813907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 82/174] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/users/b7e755f06a714e6f8be16f18f3592f97 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.815225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bad926-cfd9-4faf-9eb4-a4e87bcec13c None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.815514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bad926-cfd9-4faf-9eb4-a4e87bcec13c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.815849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bad926-cfd9-4faf-9eb4-a4e87bcec13c None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.817110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 83/175] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:22.818245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03b15-b2e7-43ad-8e2d-df85f04b53c4 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.818601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03b15-b2e7-43ad-8e2d-df85f04b53c4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.818871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec03b15-b2e7-43ad-8e2d-df85f04b53c4 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.820128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 84/176] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:22.820816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec03b15-b2e7-43ad-8e2d-df85f04b53c4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.839739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.858045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:22.920717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7970-86fa-4ac8-8e00-a2abaa0f0c76 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.928176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec03b15-b2e7-43ad-8e2d-df85f04b53c4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:22.957059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.958129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.958637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.959380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] PATH_INFO: `/v3/users/c645bfdb45ef433289f7ec009efccb8d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.960713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] RBAC: Authorizing `identity:get_user(user_id=c645bfdb45ef433289f7ec009efccb8d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.962297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:22.962657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.962923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.963200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.963471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.964188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:22.964488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:22.965491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 93/177] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/users/c645bfdb45ef433289f7ec009efccb8d => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.966685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:22.966986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c7914-f5c1-46f1-b10a-718ae85586ac None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:22.973266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 85/178] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=072aae4a92604daca4ad778a1b442950 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:22.974444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cc60-4e54-4d93-befe-c02788a4ea47 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:22.974763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cc60-4e54-4d93-befe-c02788a4ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:22.975028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cc60-4e54-4d93-befe-c02788a4ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:22.995802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b4d0cc60-4e54-4d93-befe-c02788a4ea47 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:22.997015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b4d0cc60-4e54-4d93-befe-c02788a4ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:23.072964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 86/179] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:23.074766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.075258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.075708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.089046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.094665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:23.096127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:23.101573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb66a-72cf-44ad-96b7-1fcfaab5f568 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.125312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.171067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.171989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.172446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.172919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.174505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 87/180] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:23.175325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.280006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.281594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.289837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fdd67-17e9-48d7-9efe-31b4fadb731f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.327347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.328260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.328719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.329184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.341131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:23.346388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:23.347302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:23.348096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:23.350386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 88/181] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:23.351582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.372630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.380273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.391710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 94/182] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:23.392815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.466768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab85d5-787c-434a-9330-333b777e60e2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.507057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a625-2055-4912-ab18-5db25edf6876 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.507994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.508609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.508908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.509344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.548079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.548696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.548981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.549259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.549928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:23.550239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.551760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.560291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 95/183] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:23.561161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.589353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.590765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.608369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.617310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.662460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256103c-de00-410b-807b-aedbdaf88d4d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.687766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 89/184] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:23.691414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.696986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.697621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.697904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.698181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.699694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.701152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d3d36-79f8-42ed-be56-6aa52c6eec2c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.702826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 96/185] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:23.704067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87bba8-cfc2-4ebd-b4ab-a3c52564179a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.704354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87bba8-cfc2-4ebd-b4ab-a3c52564179a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.704632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87bba8-cfc2-4ebd-b4ab-a3c52564179a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.705847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 97/186] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:23.706626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87bba8-cfc2-4ebd-b4ab-a3c52564179a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.788805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a565-119e-4820-9ec9-e9113381e780 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.805143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.810692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87bba8-cfc2-4ebd-b4ab-a3c52564179a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.823367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.823987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.824263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.824535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.833570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:23.834400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:23.839653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:23.840607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 90/187] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:23.841417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.850779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.851415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.851696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.851975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.853106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.854538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.856136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 98/188] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:23.859491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.938999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07220b5-f664-41b4-b825-38efc41ce17f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.955873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d25c80-c40f-48bc-ace8-0a978e2492fd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:23.972547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.973171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.973453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.973729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.986390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.987882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.987999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:23.988600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:23.988910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:23.989184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] PATH_INFO: `/v3/projects/3391117e441d414aa19e85adb725359c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:23.989485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 91/189] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:23.990251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:23.995554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] RBAC: Authorizing `identity:get_project(project_id=3391117e441d414aa19e85adb725359c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:23.997022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b1d49-f735-4c3f-85cb-2aab0b9136d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:23.998825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 99/190] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/projects/3391117e441d414aa19e85adb725359c => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:23.999968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.000251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.000521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.018301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:24.019592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:24.028911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.071305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.085732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 100/191] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:24.086529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.097171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ee1e-fc9a-4056-98de-0710814e6844 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.133171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.134823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.135112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.135389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.136501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=b7e755f06a714e6f8be16f18f3592f97) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:24.136812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.138584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.150711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 92/192] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:23 2022] GET /identity/v3/role_assignments?user.id=b7e755f06a714e6f8be16f18f3592f97&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:24.152999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.205335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c197a-1010-4d7c-814f-e8726c3c916a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.244927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.245922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.246410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.246939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.247830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:24.248388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.250015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.260294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 101/193] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:24.261515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.294429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.298654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb9805-dd73-47b9-b3ab-fcdbd24e1078 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.335471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.340040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.340659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.340939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.341469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.341865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.343357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.369814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 93/194] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:24 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:24.370477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.404152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d0fa-3864-4346-b1e0-2679b5563b5e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.458726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.459726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.460008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.460405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.513800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031221b-5788-4228-976e-98d78ab7ea37 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.557609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.559372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.565447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.566071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.566354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.567486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.567486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=3391117e441d414aa19e85adb725359c, user.id=c645bfdb45ef433289f7ec009efccb8d) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:24.567714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.569643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.576726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 94/195] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/role_assignments?user.id=c645bfdb45ef433289f7ec009efccb8d&scope.project.id=3391117e441d414aa19e85adb725359c&role.id=3a794b68c0934063ac3400ead0e17439 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:24.583600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.620948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.633951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.704961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 102/196] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:24.705848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.742135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4a07-add9-4270-8df4-d1c9c7d5988e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.783318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.783960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.784295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.784499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.786296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.787814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.789757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 95/197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:24.791162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.847754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ab3a-ac03-49dd-a2b5-3d86f9d9f994 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.889944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.897133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.897906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.898266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.898542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.906523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018777fb-069c-4d34-bf2d-6065b4ffe7bc None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:24.916139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:24.921127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:24.922191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 103/198] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:24.924179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:24.941749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:24.965550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:24.966306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:24.966604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:24.966888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:24.968031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:24.969657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:24.971467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 96/199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:24.972316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.059630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce78df-0b8a-4591-a7b4-71e351badd86 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.092252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b371f4-6a00-4516-bf65-0d94fed24fe6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.107975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.109074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.109485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.109915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.130624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.131741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.132298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.132625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.133425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:25.133750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.136098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.150523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 97/200] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:25.155523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.175558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:25.201259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.203364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.219846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:25.283555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c46a-06fb-46fd-a3ad-5e779c9ada74 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.336581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 104/201] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:25.337776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.350594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.350594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.350594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.350594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.350975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=919565d4525e425299a088d12c10c19e) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:25.350975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.353463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.368533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 98/202] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:25 2022] GET /identity/v3/role_assignments?user.id=919565d4525e425299a088d12c10c19e&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:25.369623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.509941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:25.524568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1070fb-fbfb-499f-bef0-4559385f28d3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.565959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.566941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.570928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.571966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.573354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.575027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.576957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 99/203] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:25 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:25.583532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.591841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666d8e-3c1f-4684-bfe5-def566635fc9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.607146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:25.699903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6ae-ccc4-4b61-9829-d959d196a01c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:25.737334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.738372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.738893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.739455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.740395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=919565d4525e425299a088d12c10c19e) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:25.740901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.742545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.749300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 100/204] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:25 2022] GET /identity/v3/role_assignments?user.id=919565d4525e425299a088d12c10c19e&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=072aae4a92604daca4ad778a1b442950 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:25.759517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:25.760245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:25.760471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:25.760746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] PATH_INFO: `/v3/users/4837bdb321ea457b863b803b554243c5` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:25.767535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] RBAC: Authorizing `identity:get_user(user_id=4837bdb321ea457b863b803b554243c5)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:25.769043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:25.771168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 105/205] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:25 2022] GET /identity/v3/users/4837bdb321ea457b863b803b554243c5 => generated 289 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:25.778848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:25.827089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:25.996504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402440c0-25c6-4e64-873a-aa6ce6905b5d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:26.071912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:26.072446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.072730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.073000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.188133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:26.189631 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:26.219681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:26.341019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 101/206] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:26.346206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:26.518760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b58a-ef98-49b7-9341-963707a91461 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:26.573185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:26.573828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.574112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.574392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.575578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:26.577013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894ab0c-73ac-419b-ba97-f846f2c5f539 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:26.578678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 106/207] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:26 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:26.584988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:26.745362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c363a2-cce6-4e89-afaf-0f30e8e99a7d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:26.762704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:26.796152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:26.796795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.797079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.797352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.798100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, scope.project.id=6e178654f0164832bb497d0217f65a88, user.id=4837bdb321ea457b863b803b554243c5) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:26.798410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:26.799953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793b8-a5f3-4a75-afad-7322e039def8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:26.807375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 102/208] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:26 2022] GET /identity/v3/role_assignments?user.id=4837bdb321ea457b863b803b554243c5&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=c7af1985884c4d939727628fc6a7963e => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:26.838937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5eb0-c983-40be-bc34-0ce5d3d49a25 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5eb0-c983-40be-bc34-0ce5d3d49a25 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.840066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5eb0-c983-40be-bc34-0ce5d3d49a25 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.841627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 107/209] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:26.847591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2bf6-cae2-4f93-b674-dc0f6cb0c43b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.848218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2bf6-cae2-4f93-b674-dc0f6cb0c43b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.848713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2bf6-cae2-4f93-b674-dc0f6cb0c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.867327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-694e2bf6-cae2-4f93-b674-dc0f6cb0c43b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:26.868900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-694e2bf6-cae2-4f93-b674-dc0f6cb0c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:26.964987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 103/210] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:26.976281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162d1b-755e-446b-b9fd-cb56adc24c40 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.976590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162d1b-755e-446b-b9fd-cb56adc24c40 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.976840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162d1b-755e-446b-b9fd-cb56adc24c40 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:26.978287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 108/211] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:26.983983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:26.984275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:26.984556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.009874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:27.011026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:27.080348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 104/212] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:27.249852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162d1b-755e-446b-b9fd-cb56adc24c40 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.306603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:27.369271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162d1b-755e-446b-b9fd-cb56adc24c40 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.375410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.416874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.417514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.417799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.418115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.432051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:27.438034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:27.438948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:27.439949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 109/213] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:27.442431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:27.445392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.490933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3883c2c-b99b-45ff-aa68-1c6e42715eb4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.535040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.535938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.536222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.536881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.538006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:27.540554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:27.546661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 105/214] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:27.548566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.559662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175357-3b10-4ab1-ac43-90be245df4c3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.569606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:27.599183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.599916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.600197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.600474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.601188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:27.601496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:27.603701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:27.612557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 110/215] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:27.622607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.667462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b1d1-a088-44c8-ae27-04e9e3d2a4de None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.675826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:27.706610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.707504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.707963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.708450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.709597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:27.711234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:27.730828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac555-6df1-4f6b-a321-1155fcb050ad None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.740536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 106/216] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:27 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:27.771632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.772293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.772625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.772906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] PATH_INFO: `/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.789966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] RBAC: Authorizing `identity:get_user(user_id=b5c22bd3c1ab4b0cae04ef1464d12c01)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:27.792082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004bc0-fc57-4b15-b422-b423d2ce544e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:27.794399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 111/217] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:27 2022] GET /identity/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:27.800727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:27.831432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127d03c-df23-440f-98a2-1ce876359c3b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.831744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127d03c-df23-440f-98a2-1ce876359c3b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.832108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127d03c-df23-440f-98a2-1ce876359c3b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.835251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 112/218] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:27.840431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.840799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.841155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.864804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:27.866166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:27.889033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:27.919793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955cbeb-6226-4fc4-bceb-685f958c1c8c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:27.943256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:27.956655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:27.957298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:27.957579 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:27.957852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:27.992594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.034070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:28.035593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd81e-e35b-4aad-8587-66c99329b1d6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:28.142093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 107/220] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:28.147670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.172096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2400-761f-4bb4-bc37-5bef5ad9733b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.172377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2400-761f-4bb4-bc37-5bef5ad9733b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.172860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2400-761f-4bb4-bc37-5bef5ad9733b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.174552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 108/221] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:28.180701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.180987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.181318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.202422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:28.203886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:28.278101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116bbd5-b212-4043-bfd2-01de0f714969 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.287089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.302216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 109/222] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:28.303939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.314984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.316094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.316571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.317296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.319007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:28.320457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:28.323072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 114/223] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:28.334015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.388222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.422499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa7dcc-67df-4434-9a9f-e6469acbfb2a None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.459463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.460595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.461073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.461572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.472665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:28.478032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:28.479138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:28.479918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:28.482039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 110/224] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:28.494069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.525230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b29bc-d1aa-4ebd-a40f-776d329a962e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.582717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.583764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.584044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.584618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.585365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=b5c22bd3c1ab4b0cae04ef1464d12c01) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:28.585673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:28.587171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:28.595354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.601789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 115/225] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/role_assignments?user.id=b5c22bd3c1ab4b0cae04ef1464d12c01&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=3a794b68c0934063ac3400ead0e17439 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:28.624806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.683011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281713bb-34eb-46e3-b47a-a48c7ea192ad None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.737336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.738035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.738319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.738615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.739305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:28.739608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:28.741029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:28.762921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 111/226] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:28.769135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.827870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.850944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e68b99-0fa5-45fa-8296-60f67f95f5c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.927116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe884-e97c-4046-ac8c-12139641da6f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:28.929081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.929725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.930007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.930282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.947905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:28.953104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:28.953968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:28.954790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:28.955894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:28.959820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 116/227] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:28.965732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:28.990620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:28.991270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:28.991552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:28.991827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:28.994537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:28.996019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:28.998246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 112/228] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:29.005417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:29.136526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699283-ee08-4d9a-85bc-def7d0e26eb8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.191653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d88cf-f0aa-4943-bf25-c0d2fe1d166c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.206425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.206993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.207272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.207546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.208222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:29.208526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.210183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.230167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 117/229] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:29.249322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:29.262726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:29.263691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.264396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.265753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.266119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.268722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.270223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.273568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 113/230] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:29 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:29.278764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:29.353850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:29.389007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5017e5-5369-4ea6-8211-0c03cf890ad6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.423660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.424324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.424607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.424884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/919565d4525e425299a088d12c10c19e/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.426826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, user_id=919565d4525e425299a088d12c10c19e, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.428267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.441981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 114/231] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:29 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/919565d4525e425299a088d12c10c19e/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:29.466533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5401b8-fee4-4c8c-8a4a-975838eae6e1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.505123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.505819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.506102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.506426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.507679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.509180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.514814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 118/232] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:29 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:29.517746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:29.635354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76db787-46f2-45cf-b583-b5a61f6f40ec None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.646889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:29.672932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.673570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.673847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.674120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.675306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.676757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc19a4-232f-424c-b598-9c12f607d138 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.678400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 115/233] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:29 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:29.684509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:29.769373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:29.796828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b8f3-c775-4049-8945-2da7f488b3a3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:29.831812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:29.832527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:29.832809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:29.833088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/919565d4525e425299a088d12c10c19e/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:29.835601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, user_id=919565d4525e425299a088d12c10c19e, role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:29.837600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11d4e0-81ae-406b-a0a1-915b773bb598 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:29.858627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 119/234] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:29 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/919565d4525e425299a088d12c10c19e/roles/072aae4a92604daca4ad778a1b442950 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:30.265141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec0-1919-4fdc-a42e-eb549698b476 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.265644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec0-1919-4fdc-a42e-eb549698b476 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.265743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676ec0-1919-4fdc-a42e-eb549698b476 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.267363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 116/235] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:30.272676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.272969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.273252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.290981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18749e-9985-49e8-8f50-56bb80642d76 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.291279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18749e-9985-49e8-8f50-56bb80642d76 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.291529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18749e-9985-49e8-8f50-56bb80642d76 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.293012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 117/236] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:30.295287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:30.296493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:30.298581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.298880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.299157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.324680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:30.325885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:30.429488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 120/237] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:30.461494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 118/238] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:30.763122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:30.787347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:30.844373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:30.884712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c664ca9-2564-4703-be57-7aef309e1132 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:30.922208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:30.923267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.923722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.924135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.936480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-2075a624-58af-4484-ac6e-853c221da706 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:30.942398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:30.943330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:30.944102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 121/239] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:30.944774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721f4a-b02d-4c15-9371-770a8a4a62a9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.945563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721f4a-b02d-4c15-9371-770a8a4a62a9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.946747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721f4a-b02d-4c15-9371-770a8a4a62a9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.948463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 122/240] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:30.953881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:30.955035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:30.955542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:30.980912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:30.981640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d28f-c125-4523-964e-711805af8f95 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:30.982674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:30.993350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.033130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.034104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.034614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.035111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.036428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.038638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.046493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 119/241] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:31.048234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.074619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 123/242] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:31.074619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.176320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.202290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9c0a6-1805-4e4c-a6f9-ecc97094caee None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.252143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94fe58-5947-4648-ba60-88cc542283d8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.276010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.276624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.276902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.277175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.277842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:31.278146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.279560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.298290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 120/243] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:31.302727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.322680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.323304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.323581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.323853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.324506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.325972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.359486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.374768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 124/244] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:31 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:31.423699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cce0-d4da-4979-9237-142827a2550f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.456801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.460715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.461376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.461657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.461980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] PATH_INFO: `/v3/users/976e8ee849164b82a8ccd30aace97dad` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.494845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] RBAC: Authorizing `identity:get_user(user_id=976e8ee849164b82a8ccd30aace97dad)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.496354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.499597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 121/245] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/users/976e8ee849164b82a8ccd30aace97dad => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:31.505978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.637696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f84ce-b744-4985-a9c2-e3a41f90ff64 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.657553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.663227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.672903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c967-2eb7-4122-8ef3-dd11899dab68 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.687822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.688042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.688326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.688602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.705509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:31.713941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:31.714832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:31.715638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 125/246] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:31.721791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.730833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.731463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.731798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.732078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.821692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.823264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd5fe-0904-4239-b7b3-cc3909bf6e28 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.851780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e092ee-0e2d-4d20-b038-c7d01a0d5b53 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:31.901057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:31.902009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.902485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.902973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.903880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:31.904378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:31.908739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:31.929388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 126/247] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:31.936419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.953367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:31.960232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 122/248] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:31.961504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6537e-2a91-4004-8603-25a8036aaa3b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:31.961814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6537e-2a91-4004-8603-25a8036aaa3b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:31.962093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6537e-2a91-4004-8603-25a8036aaa3b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:31.963404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 123/249] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:31.970181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6537e-2a91-4004-8603-25a8036aaa3b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:31.986345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:32.064057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37b8f6-22f5-4130-bcb8-58be600db3e9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.093088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6537e-2a91-4004-8603-25a8036aaa3b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.109402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.110761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.111077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.114739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] PATH_INFO: `/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.117064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] RBAC: Authorizing `identity:get_user(user_id=b5c22bd3c1ab4b0cae04ef1464d12c01)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:32.119201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7eea27-50b0-4ce7-a64c-45e1b9ee3700 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:32.121789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 127/250] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:32.127077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.128670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.129145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.156184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:32.157666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:32.161125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.162016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.162490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.163049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.164430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:32.166652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:32.168632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 124/251] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:31 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:32.169641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.263003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:32.277765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 128/252] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:32.286983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.319191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc5c4-b1aa-4d5e-8f00-7b92db2bf710 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.350822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:32.381552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.382197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.382481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.382795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.384037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:32.385486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c38df6-25ab-4500-842b-68be35e340fb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:32.387238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 125/253] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:32 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:32.388588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a2d9-388b-499a-b5b4-62bd046b26ee None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.388875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a2d9-388b-499a-b5b4-62bd046b26ee None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.389151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a2d9-388b-499a-b5b4-62bd046b26ee None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.390357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 126/254] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:32.395458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a2d9-388b-499a-b5b4-62bd046b26ee None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.424034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a8463-45e8-4eb2-b2f2-94283ff87724 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.462414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.463060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.463340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.463614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.464340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=976e8ee849164b82a8ccd30aace97dad) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:32.464640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:32.466074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e2b5e-d977-42f9-8ae9-670d140fc958 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:32.471743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 129/255] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:32 2022] GET /identity/v3/role_assignments?user.id=976e8ee849164b82a8ccd30aace97dad&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=c7af1985884c4d939727628fc6a7963e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:32.473041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.473326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.473597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.493369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:32.494545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:32.570111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 130/256] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:32.603734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a2d9-388b-499a-b5b4-62bd046b26ee None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.607674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.645512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:32.663667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:32.677420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.678029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.678352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.678663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/b5c22bd3c1ab4b0cae04ef1464d12c01/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.680732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, user_id=b5c22bd3c1ab4b0cae04ef1464d12c01, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:32.682251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:32.717633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 127/257] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:32 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/b5c22bd3c1ab4b0cae04ef1464d12c01/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:32.753136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28e68-fcce-4e46-a027-84ed986b9e67 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:32.806665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:32.807331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:32.807609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:32.807879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:32.819658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:32.824947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:32.825844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:32.826655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 131/258] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:32.832933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.973916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:32.976897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61676d85-10f8-4403-ab40-4c049d6904d3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.021900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.022524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.022835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.023108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.023773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:33.024076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.025552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:33.037304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 128/259] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:33.068567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:33.078139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:33.092800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca47da5-8c0d-41c1-b40f-9c72f795693c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.129764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.130512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.130823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.131097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.142752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:33.147640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:33.148525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:33.149339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:33.153682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 132/260] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:33.158342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:33.208361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:33.267580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd736c-6fec-4272-bb69-de012abbdb16 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.286551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e31c-915b-47fa-9b97-80e931ef74be None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.304141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.304754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.305034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.305300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.306518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:33.306847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.308212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:33.316647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 133/261] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:33.322332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:33.335363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:33.345803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.347504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.349747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.350032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.352363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.356771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:33.360375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 129/262] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:33 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:33.364320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:33.458964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423adaa-9a05-4e25-8030-aabb2bbb0d2c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.523880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.524477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.524758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.525031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] PATH_INFO: `/v3/users/919565d4525e425299a088d12c10c19e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.526171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] RBAC: Authorizing `identity:get_user(user_id=919565d4525e425299a088d12c10c19e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.527646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:33.529557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 134/263] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:33 2022] GET /identity/v3/users/919565d4525e425299a088d12c10c19e => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:33.535120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:33.558134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603f94d-dc3b-42d1-8ecd-7b59219906ed None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.620302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:33.699289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.699924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.700211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.700489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.708625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:33.728739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e7244-4868-4e52-90ca-521227256d70 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:33.784251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:33.784790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:33.785070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:33.785341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:33.860296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.862497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:33.959856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:33.961336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:34.063553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 130/264] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:34.069163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:34.092850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:34.122753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:34.132639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 135/265] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:34.138963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:34.287423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0571d8-6168-4eed-aff0-6954a20d387f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:34.297993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e4c87-89bd-420e-9df3-d21594496eba None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:34.335946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:34.336499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.336844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.337682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.338837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:34.340750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:34.346670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 136/266] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:34 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:34.348679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:34.371643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:34.372405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.372692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.372970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.375410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:34.376876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:34.379083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 131/267] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:34 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:34.385326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:34.406068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:34.515117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaef6-ee60-4967-bd7b-b0db65e835b2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:34.555367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:34.576163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8b07-b920-4fd9-b750-196d49549343 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:34.591363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:34.592674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.592951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.593220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.593948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=919565d4525e425299a088d12c10c19e) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:34.594254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:34.595734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e20bfa-3b28-4f37-8377-d366f4ca064e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:34.615735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 137/268] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:34 2022] GET /identity/v3/role_assignments?user.id=919565d4525e425299a088d12c10c19e&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=072aae4a92604daca4ad778a1b442950 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:34.617259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa1bd-7486-47e0-af99-5a90559e4060 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.617547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa1bd-7486-47e0-af99-5a90559e4060 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.617834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa1bd-7486-47e0-af99-5a90559e4060 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.622594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 138/269] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:34.626894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890a12-326f-4771-8f51-693df9f135a7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.627167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890a12-326f-4771-8f51-693df9f135a7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.627434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890a12-326f-4771-8f51-693df9f135a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.646663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:34.647284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.647564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.647837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.648561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=919565d4525e425299a088d12c10c19e) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:34.648922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:34.650437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62273c-af1e-4a93-b64a-803a687c61b3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:34.669306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 132/270] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:34 2022] GET /identity/v3/role_assignments?user.id=919565d4525e425299a088d12c10c19e&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:34.679928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d4890a12-326f-4771-8f51-693df9f135a7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:34.681998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4890a12-326f-4771-8f51-693df9f135a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:34.768100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 139/271] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:34.792771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae4ec-88d8-40b9-944f-8132fdbca75d None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.793090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae4ec-88d8-40b9-944f-8132fdbca75d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.793321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae4ec-88d8-40b9-944f-8132fdbca75d None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.795042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 133/272] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:34.800701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:34.800989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:34.801262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:34.821661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:34.822903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:34.873678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:34.916306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 140/273] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:35.152152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae4ec-88d8-40b9-944f-8132fdbca75d None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.219235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.276907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae4ec-88d8-40b9-944f-8132fdbca75d None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.321464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18882004-92cc-449a-9971-f910a212c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.322104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18882004-92cc-449a-9971-f910a212c761 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.322387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18882004-92cc-449a-9971-f910a212c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.323148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18882004-92cc-449a-9971-f910a212c761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.323796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18882004-92cc-449a-9971-f910a212c761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:35.325242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18882004-92cc-449a-9971-f910a212c761 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:35.327155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 134/274] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:35.328164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7039-9271-4835-aa17-d4e5303f1090 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.328447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7039-9271-4835-aa17-d4e5303f1090 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.328782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7039-9271-4835-aa17-d4e5303f1090 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.330251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 135/275] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:35.335733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.336019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.336293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.355275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:35.356443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:35.361992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d16d1e-8cf2-4bcd-9572-e27476a942a9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.374506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:35.397509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.398134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.398412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.398713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.409447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:35.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:35.415729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:35.416687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:35.420456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 141/276] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:35.421364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.441761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 136/277] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:35.441761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.467073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:35.545206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b33c-8fc0-4a44-9ff9-2aec1f7bf710 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.559485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b398d-037b-4c6b-b3ec-490f144df058 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.585270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.585864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.586144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.586412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.587624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:35.589064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:35.595779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.596385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.596675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.596948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.597608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] RBAC: Adding query filter params (name=member) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:35.597914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:35.599517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3a95-d6e9-4968-9c8f-3afdd0e5a263 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:35.614711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 137/278] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:35.614711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556886d-ce8b-4fe7-825f-1ada1137e3f3 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.614711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556886d-ce8b-4fe7-825f-1ada1137e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.614711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556886d-ce8b-4fe7-825f-1ada1137e3f3 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.615089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 142/279] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:11:35 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:35.617225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 138/280] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:35.620075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.620644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.621109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.621600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.646331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:35.648512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:35.667104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:35.723782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:35.740692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1c20f-993e-436a-9c40-d1d9d4a6df31 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.747392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 139/281] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:35.749049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.787092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.787730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.788012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.788287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] PATH_INFO: `/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.806383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] RBAC: Authorizing `identity:get_user(user_id=3511b6bdcbab4565b6cc6ce1af1628ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:35.807884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:35.809935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 143/282] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:35.815514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.870995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9007-55ec-407f-af8f-2c003803ef18 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.917020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:35.918017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:35.918276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:35.918945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:35.935283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:35.940362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:35.941242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:35.942065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 140/283] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:35.948084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:35.950173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e980999-731c-4fbd-b23c-c278893f8df9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:35.952826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.000891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.001500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.001783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.002057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.002821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, user.id=3511b6bdcbab4565b6cc6ce1af1628ec, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:36.003129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.004566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.010776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 144/284] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/role_assignments?user.id=3511b6bdcbab4565b6cc6ce1af1628ec&scope.system=all&role.id=3a794b68c0934063ac3400ead0e17439 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:36.028039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.040389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.078629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb45a-3b93-4ad8-8d13-633253461b18 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.161622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.162486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.162949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.163604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.164446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:36.166086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.167875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.187850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 141/285] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:36.189482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ca95-c5d2-4f28-9fd8-097edc880658 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.194590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.225602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.226241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.226794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.227289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.238235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:36.244375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:36.245245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:36.246016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:36.248762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 145/286] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:36.255557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.278613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.311282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e06113-bbd9-41f9-9a3a-e1a171a0f07d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.347623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.348281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.348661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.349032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] PATH_INFO: `/v3/users/976e8ee849164b82a8ccd30aace97dad` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.350316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=976e8ee849164b82a8ccd30aace97dad)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.352155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.354834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 142/287] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/users/976e8ee849164b82a8ccd30aace97dad => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:36.360557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.363956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.398711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3d15-ad31-4ed9-bb8a-6c4a0d6f9463 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.476564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c862-3c68-4927-b89c-4fa8fe1c4ae9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.489691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.490307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.490599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.490878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.491642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:36.491946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.494046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.513493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 146/288] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:36.515020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.515652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.515932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.516207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.517431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.518991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.519100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.520975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 143/289] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:36.528183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.531053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.686591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419b8a9-c5ab-4546-b0e9-6f96bf7ee6f0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.729725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:36.732574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f6e5-e5fd-4049-98fd-3cd4ad9d3839 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.745935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.746665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.746945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.747213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] PATH_INFO: `/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.749146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] RBAC: Authorizing `identity:get_user(user_id=b5c22bd3c1ab4b0cae04ef1464d12c01)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.750713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.752285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 147/290] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/users/b5c22bd3c1ab4b0cae04ef1464d12c01 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:36.758105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:36.799502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.800179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.800458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.800730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/976e8ee849164b82a8ccd30aace97dad/roles/c7af1985884c4d939727628fc6a7963e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:36.807404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, user_id=976e8ee849164b82a8ccd30aace97dad, role_id=c7af1985884c4d939727628fc6a7963e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:36.808851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:36.828205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 144/291] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:11:36 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/users/976e8ee849164b82a8ccd30aace97dad/roles/c7af1985884c4d939727628fc6a7963e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:11:36.925759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2f22-69f5-439e-ac02-be9df363b9fd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:36.962803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:36.963434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:36.963714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:36.963991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:37.038492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:37.043659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:37.045184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:37.158596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 148/292] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:37.164592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:37.263572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:37.312455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc5816-e39e-495a-92fe-3a211426056d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:37.358032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:37.358687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:37.358972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:37.359245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:37.360381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:37.361806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a28119-cde3-4454-a29b-21476fe7e024 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:37.363631 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 145/293] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:37 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:37.369540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:37.480932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:37.485588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eaaa4-812a-4d47-9f5f-88f37f184006 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:37.523983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:37.524632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:37.524913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:37.525187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:37.525914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=b5c22bd3c1ab4b0cae04ef1464d12c01) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:37.526220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:37.527779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e3ec8-512b-4106-8df4-97a4db16e6c7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:37.534748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 149/294] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:37 2022] GET /identity/v3/role_assignments?user.id=b5c22bd3c1ab4b0cae04ef1464d12c01&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=3a794b68c0934063ac3400ead0e17439 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:38.075993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c6f-49e0-4a99-921d-7276496175cb None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.077022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c6f-49e0-4a99-921d-7276496175cb None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.077518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c6f-49e0-4a99-921d-7276496175cb None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.079455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 146/295] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:38.085292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaf1d-3edb-4c10-81db-823b2acb5d5d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.085806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaf1d-3edb-4c10-81db-823b2acb5d5d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.086291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaf1d-3edb-4c10-81db-823b2acb5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.106437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dbcaaf1d-3edb-4c10-81db-823b2acb5d5d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:38.107967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dbcaaf1d-3edb-4c10-81db-823b2acb5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:38.142687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1e3b-72e3-4400-8555-efe7905eea10 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.143448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1e3b-72e3-4400-8555-efe7905eea10 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.144037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1e3b-72e3-4400-8555-efe7905eea10 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.146025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 147/296] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:38.151524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f82ec-2930-4fdc-8a56-70cf449faaf3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.152060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f82ec-2930-4fdc-8a56-70cf449faaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.152535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f82ec-2930-4fdc-8a56-70cf449faaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.173179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c00f82ec-2930-4fdc-8a56-70cf449faaf3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:38.174837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c00f82ec-2930-4fdc-8a56-70cf449faaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:38.190050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 150/297] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:38.252451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 148/298] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:38.405313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127e54-c014-491a-97fc-ca70795aed38 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.405834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127e54-c014-491a-97fc-ca70795aed38 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.405834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127e54-c014-491a-97fc-ca70795aed38 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.407463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 151/299] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:38.412833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.413334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.413834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.432597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:38.434045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:38.468828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81127e54-c014-491a-97fc-ca70795aed38 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.498734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:38.510878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 149/300] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:38.529073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.581194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:38.595875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81127e54-c014-491a-97fc-ca70795aed38 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:38.639529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:38.640808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.641393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.641906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.652935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebe7b1-522e-4b29-b146-b4a5184609dc None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:38.656372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:38.661003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:38.661890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:38.662711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 152/301] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:38.668029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.692820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:38.693743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.694188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.694627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.695871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:38.698011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:38.700128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 150/302] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:38.705633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.778291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:38.786315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b845-f926-4930-9194-e909bc5eb240 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:38.826068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2755f-bb2e-4dc2-95a5-24cb7b61a3d5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:38.828642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:38.829449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.829735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.830012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.830703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:38.831010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:38.832372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:38.842727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 153/303] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:38.842727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.859369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:38.863230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:38.863842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:38.864122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:38.864392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] PATH_INFO: `/v3/groups` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:38.865011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:38.866430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:38.882679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 151/304] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Aug 19 02:11:38 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:11:38.884500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:38.978527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857725c4-c034-44ef-a041-6128fae6ea50 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.027008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98396eb-94fb-4993-9613-35b1d3b64aec None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.030873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.031422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.031707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.031984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.048253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:39.048864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:39.054314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:39.055468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:39.056473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:39.058399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 154/305] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:39.064819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.075642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.076334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.076880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.076880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] PATH_INFO: `/v3/users/2d4ceb176fcb404da4cd5a2897359df3` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.092334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] RBAC: Authorizing `identity:get_user(user_id=2d4ceb176fcb404da4cd5a2897359df3)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.094107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.096321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 152/306] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:38 2022] GET /identity/v3/users/2d4ceb176fcb404da4cd5a2897359df3 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:39.103174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.155724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:39.181299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38498d-717f-4f13-82b5-ce4ee7011669 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.215676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.216277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.216546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.216811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.217460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:39.217814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.219212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd389a-392c-467a-a110-a02623d86450 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.221451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1aa6e-06aa-47b8-bd07-232c93d5d072 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.232586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 155/307] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:39.232586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645059a-86b2-49f4-b79f-add1fe03c490 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.232586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645059a-86b2-49f4-b79f-add1fe03c490 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.232586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645059a-86b2-49f4-b79f-add1fe03c490 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.232586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 156/308] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:39.233577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645059a-86b2-49f4-b79f-add1fe03c490 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.265309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.266062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.266350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.266812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.267864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, user.id=2d4ceb176fcb404da4cd5a2897359df3, scope.system=all) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:39.268474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.269923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b351c-5f84-42a3-abb2-e14d11bd52ea None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.282630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 153/309] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/role_assignments?user.id=2d4ceb176fcb404da4cd5a2897359df3&scope.system=all&role.id=c7af1985884c4d939727628fc6a7963e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:39.282630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.282630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.282630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.307994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:39.309410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:39.365675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:39.366556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645059a-86b2-49f4-b79f-add1fe03c490 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.388522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 154/310] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:39.419738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.419738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.420356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.420356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] PATH_INFO: `/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.421400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] RBAC: Authorizing `identity:get_user(user_id=3511b6bdcbab4565b6cc6ce1af1628ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.423249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.424781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 157/311] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:39.430086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.540919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907c33-3ccf-440f-bfc6-c83d525142cc None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.576969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.578045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.578507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.579014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] PATH_INFO: `/v3/system/users/3511b6bdcbab4565b6cc6ce1af1628ec/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.580618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3511b6bdcbab4565b6cc6ce1af1628ec, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.582172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.592629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 155/312] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Aug 19 02:11:39 2022] PUT /identity/v3/system/users/3511b6bdcbab4565b6cc6ce1af1628ec/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:39.665285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.669762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:39.775413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a816-8cfa-49ef-9383-2da13dd36333 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.809354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.810355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.810862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.811352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.822367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:39.827868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:39.828742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:39.829516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:39.832056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 158/313] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:39.838592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:39.872936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:39.943275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae048b-7e81-4a3b-a578-06132a788a39 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:39.979356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:39.980331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:39.980811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:39.981308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:39.982170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:39.982702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:39.984307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:39.993697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 156/314] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:39.999462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:40.065811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:40.107839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ceaf8-a141-4cbb-afed-0d2ae4642fab None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:40.142379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:40.143300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.143788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.144239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] PATH_INFO: `/v3/users/976e8ee849164b82a8ccd30aace97dad` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.148297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] RBAC: Authorizing `identity:get_user(user_id=976e8ee849164b82a8ccd30aace97dad)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:40.149951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:40.151881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 159/315] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:39 2022] GET /identity/v3/users/976e8ee849164b82a8ccd30aace97dad => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:40.159867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:40.263188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:40.272121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d356-a70d-46fc-823d-59e246c38ed3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:40.306599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:40.307220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.307502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.307777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.378470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:40.379990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:40.478471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:40.485543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 157/316] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:40.490963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:40.595143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549008-bebd-43bd-af52-ea0853caf19d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:40.624786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:40.630155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:40.630764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.631057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.631339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.632999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:40.634841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b1e37-5b67-4a69-ad31-357ae803a7a1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:40.636842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 160/317] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:40 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:40.646739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:40.749705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abaa3-8730-4b6a-9a72-d25539a9f065 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:40.785760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:40.786369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.786674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.786949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.787673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, scope.project.id=14b822d77c064c1bbcd0377c0aed4241, user.id=976e8ee849164b82a8ccd30aace97dad) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:40.787979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:40.789413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da24df9-6087-4a44-bea0-1a875f67e179 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:40.796267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 158/318] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:11:40 2022] GET /identity/v3/role_assignments?user.id=976e8ee849164b82a8ccd30aace97dad&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=c7af1985884c4d939727628fc6a7963e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:40.909511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbe925-b42e-4a3b-b57c-bb9a97abc029 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.909800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbe925-b42e-4a3b-b57c-bb9a97abc029 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.909994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbe925-b42e-4a3b-b57c-bb9a97abc029 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.911669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 161/319] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:40.917380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067940-f1e8-4899-8c5f-69114a794656 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:40.917686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067940-f1e8-4899-8c5f-69114a794656 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:40.917944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067940-f1e8-4899-8c5f-69114a794656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:40.936925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-e1067940-f1e8-4899-8c5f-69114a794656 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:40.938110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e1067940-f1e8-4899-8c5f-69114a794656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:40.999890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:41.014239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 159/320] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:41.283142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbe925-b42e-4a3b-b57c-bb9a97abc029 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:41.334697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b389-3467-4244-b243-248067081d48 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.335229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b389-3467-4244-b243-248067081d48 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.335229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b389-3467-4244-b243-248067081d48 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.337101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 160/321] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:41.342127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4268b-dc2a-4825-8db6-4a1b73ab7515 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.342594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4268b-dc2a-4825-8db6-4a1b73ab7515 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.343165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4268b-dc2a-4825-8db6-4a1b73ab7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.361677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1cf4268b-dc2a-4825-8db6-4a1b73ab7515 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:41.363120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1cf4268b-dc2a-4825-8db6-4a1b73ab7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:41.392038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbe925-b42e-4a3b-b57c-bb9a97abc029 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:41.426233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:41.426904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.427181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.427452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.428544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:41.429988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:41.436341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 162/322] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:11:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:41.437025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:41.441319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 161/323] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:41.504853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:41.539779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24f46-a517-49c6-a28c-80471d8ef9a5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:41.574033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:41.574696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.574982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.575256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] PATH_INFO: `/v3/groups` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.575878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:41.577293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1c55-bb6c-42c9-8a57-83c0730f1136 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:41.594716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 163/324] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Aug 19 02:11:41 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:11:41.600378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371996f-745f-4109-b59e-2ef846a1741a None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.600666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371996f-745f-4109-b59e-2ef846a1741a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.600947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371996f-745f-4109-b59e-2ef846a1741a None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.602379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 162/325] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:41.608228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.608547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.608814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.628447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:41.629808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:41.704095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 164/326] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:41.720357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371996f-745f-4109-b59e-2ef846a1741a None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:41.825458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371996f-745f-4109-b59e-2ef846a1741a None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:41.847402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:41.863837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:41.864482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:41.864762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:41.865043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:41.875622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:41.880487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:41.881360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:41.882135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 163/327] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:41.889750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:41.951246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:41.976076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:41.998882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b648-1d67-4efd-99e8-4012253c190f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.044455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.045075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.045362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.045642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.046319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:42.047427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.048831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.062124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 165/328] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:42.067593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:42.105899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095ce38-a188-476c-978a-5f6553e830b0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.153670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.154328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.154639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.154917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.168350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:42.173448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:42.174545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:42.175655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 164/329] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:42.182522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:42.194045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b19136-0668-4b08-ad12-878d7ebbf273 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.226675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:42.248115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.248765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.249049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.249326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] PATH_INFO: `/v3/users/2d4ceb176fcb404da4cd5a2897359df3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.250754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:42.251677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] RBAC: Authorizing `identity:get_user(user_id=2d4ceb176fcb404da4cd5a2897359df3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.253777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.258465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 166/330] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:42 2022] GET /identity/v3/users/2d4ceb176fcb404da4cd5a2897359df3 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:42.262903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:42.321167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ca85-3ff2-4f4d-8ff7-df06c9fff252 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.361690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.363172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.363739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.364311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.365203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] RBAC: Adding query filter params (name=member) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:42.365727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.367564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.373640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229c84-4120-42a3-8991-3d84d4226df1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.378379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 165/331] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:42.384394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:42.409633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.410303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.410633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.410913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] PATH_INFO: `/v3/system/users/2d4ceb176fcb404da4cd5a2897359df3/roles/c7af1985884c4d939727628fc6a7963e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.412495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d4ceb176fcb404da4cd5a2897359df3, role_id=c7af1985884c4d939727628fc6a7963e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.413893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.427484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 167/332] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Aug 19 02:11:42 2022] PUT /identity/v3/system/users/2d4ceb176fcb404da4cd5a2897359df3/roles/c7af1985884c4d939727628fc6a7963e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:42.518263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17272af-a5f5-4677-b3ec-e6f8abf34112 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.519905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:42.562614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.563637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.564131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.564640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] PATH_INFO: `/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.566084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=3511b6bdcbab4565b6cc6ce1af1628ec)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.567849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ce4df-f24f-42ad-9301-1d308075f9b2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.570051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 166/333] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:42 2022] GET /identity/v3/users/3511b6bdcbab4565b6cc6ce1af1628ec => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:42.575907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:42.640556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:42.691581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c252773-0b24-41ef-b6e5-ce79480c9dc6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:42.727946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:42.728554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:42.728836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:42.729106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:42.729833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] RBAC: Adding query filter params (role.id=3a794b68c0934063ac3400ead0e17439, user.id=3511b6bdcbab4565b6cc6ce1af1628ec, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:42.730141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:42.731601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2635680-7ac5-4eff-a113-51fd5e1ddfef None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:42.744195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 168/334] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 19 02:11:42 2022] GET /identity/v3/role_assignments?user.id=3511b6bdcbab4565b6cc6ce1af1628ec&scope.system=all&role.id=3a794b68c0934063ac3400ead0e17439 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:43.863898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975190-50e8-4092-a19d-a5a7df144a8e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:43.864412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975190-50e8-4092-a19d-a5a7df144a8e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:43.864412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98975190-50e8-4092-a19d-a5a7df144a8e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:43.865789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 167/335] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:43.880743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7abb9-517c-4f31-84cb-f95a9dc00a1c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:43.881251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7abb9-517c-4f31-84cb-f95a9dc00a1c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:43.881322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7abb9-517c-4f31-84cb-f95a9dc00a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:43.906295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6ff7abb9-517c-4f31-84cb-f95a9dc00a1c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:43.907538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6ff7abb9-517c-4f31-84cb-f95a9dc00a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:43.983799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 169/336] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:44.166031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ca9c-ba9c-4e5c-921d-6fd4bff82893 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:44.166374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ca9c-ba9c-4e5c-921d-6fd4bff82893 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:44.166589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ca9c-ba9c-4e5c-921d-6fd4bff82893 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:44.168096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 168/337] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:44.175521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:44.175812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:44.176089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:44.200192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:44.201435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:44.242160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:44.284354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 170/338] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:44.545068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ca9c-ba9c-4e5c-921d-6fd4bff82893 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:44.691042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ca9c-ba9c-4e5c-921d-6fd4bff82893 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:44.734853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:44.735738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:44.736160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:44.736599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:44.751208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:44.757725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:44.758808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:44.759792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:44.766405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 169/339] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:11:44.767993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:44.911768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590f7e-136b-4c19-b203-ea5fd0703f20 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:44.915475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:44.960944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:44.962598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:44.962884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:44.963160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:44.964007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:44.964341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:44.966069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:44.970683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:44.979423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 171/340] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:45.003505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:45.072542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.114241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c435-b582-4fa4-bf9c-33ac0923fd17 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:45.182784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:45.183602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.184045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.185555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.203562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:45.205615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7db831-7d8a-4fd7-ba6a-791df59797d2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-79a4d441-1b57-476e-af7c-038127b2a294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:45.213126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:45.214210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:45.215242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:45.223384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 170/341] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:45.225640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac65b2a-6ab1-417a-bb6b-44530e10f422 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.228896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac65b2a-6ab1-417a-bb6b-44530e10f422 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.229378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac65b2a-6ab1-417a-bb6b-44530e10f422 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.231117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 171/342] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:45.232103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac65b2a-6ab1-417a-bb6b-44530e10f422 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:45.304088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:45.305061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.306362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.307790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.366459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.384865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac65b2a-6ab1-417a-bb6b-44530e10f422 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:45.427139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:45.427985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.428574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.429084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.429887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:45.430487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:45.432521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e476-a1e9-4edc-a2c0-86bcd8bf6725 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:45.442247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 172/343] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:45.443925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.444574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.445029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.468680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:45.470409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:45.471290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:45.472845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348640de-49dc-4d42-8032-5795c32a4589 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:45.549830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 173/344] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:45.551798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:45.571478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.643355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.666683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b11a-42cf-4eb9-bf6b-c7750f6210b2 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:45.680954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 172/345] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:45.680954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9190-4046-4ba8-9cb9-a68d71b51acc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.680954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9190-4046-4ba8-9cb9-a68d71b51acc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.680954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9190-4046-4ba8-9cb9-a68d71b51acc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.680954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 173/346] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:45.686383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.686626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.686903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.708319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:45.709938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:45.712014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:45.712799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.713223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.713640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.780395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 174/347] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:45.781203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:45.790045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:45.791818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:45.870956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.880678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:45.904046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 174/348] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:45.924166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:45.929712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a22d3-1503-4bd9-b0ed-ced603a9cbd3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:45.984252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:45.984812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:45.985088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:45.985365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:45.991594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:45.993254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:45.994953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 175/349] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:45 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:46.000334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.070144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0441-980f-438d-83c8-21e0ec28ed9d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.110779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.111647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.112174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.112615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.114040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.115751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.118644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 175/350] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:45 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:46.119622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.138100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0951cd8-fc14-4a93-8732-2b2d34feb1a3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.168686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.177352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.177968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.178246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.178514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.182251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.186247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.187728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.189688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 176/351] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:45 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:46.190502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.241718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b04a0-d416-490a-b6e5-d9d85c2757c6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.280282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.281275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.281711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.282124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.295829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:46.302909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:46.304023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 02:11:46.305021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:46.306293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c9cf-b7f8-485e-9648-19e3cfd0e4eb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.307874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 176/352] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:46.309927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.355781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.356413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.356701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.357731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.358298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.359763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3875-962f-47b9-afcb-0e27dfb6d644 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.361651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 177/353] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:46.367028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410be88-79fe-4073-9db0-e1d86558bbe6 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.367619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410be88-79fe-4073-9db0-e1d86558bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.368925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410be88-79fe-4073-9db0-e1d86558bbe6 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.371314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 178/354] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:46.372565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410be88-79fe-4073-9db0-e1d86558bbe6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.440130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e667-5b79-4b8c-a8a8-d4e1b453c9e2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.449822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.450853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.484655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.485270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.485554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.486904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.486904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=6e178654f0164832bb497d0217f65a88) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:46.486904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.488347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93f2c-355f-40f5-adcf-9e8212d012d2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.494409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 177/355] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=3a794b68c0934063ac3400ead0e17439 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:46.495593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed664a1-6228-4fbe-8df8-638080cd19c1 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.495882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed664a1-6228-4fbe-8df8-638080cd19c1 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.496160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed664a1-6228-4fbe-8df8-638080cd19c1 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.498458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 178/356] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:46.498744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed664a1-6228-4fbe-8df8-638080cd19c1 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.505894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410be88-79fe-4073-9db0-e1d86558bbe6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.554191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.555332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.555332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.555530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.556190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:46.556403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.557786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa467-4650-4a1a-b886-97bb776d9a9a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.569250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 179/357] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:46.570548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.574010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.574010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.592409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:46.593613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:46.659039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed664a1-6228-4fbe-8df8-638080cd19c1 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.687986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 180/358] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:46.688847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.715220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.715836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.716112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.716380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.717110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=6e178654f0164832bb497d0217f65a88) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:46.717470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:46.719117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09b764-dbb0-4a51-8b6a-b32cd88b937e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:46.725093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 179/359] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=072aae4a92604daca4ad778a1b442950 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:46.726166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.726452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.728206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.746932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:46.748440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:46.759807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.793560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:46.826501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8e64-dbe5-4ea7-9bea-4887147037ac None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:46.851848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 180/360] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:46.853393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.871638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:46.872274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:46.872554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:46.872828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:46.891874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:46.896982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:46.897874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:46.898690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 181/361] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:46.904958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:46.989917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d252fa5-843b-4d78-b3c3-7295582d57ce None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.032633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.033514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.033857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.034149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] PATH_INFO: `/v3/users/2d4ceb176fcb404da4cd5a2897359df3` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.035543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] RBAC: Authorizing `identity:get_user(user_id=2d4ceb176fcb404da4cd5a2897359df3)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.037777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.039740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8d2a7-4dc8-4594-b971-ea4a6f9009af None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.040188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 181/362] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/users/2d4ceb176fcb404da4cd5a2897359df3 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:47.045852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.060800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.091940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.092557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.092839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.093116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.093785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:47.094088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.095652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.096880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.109488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 182/363] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:47.115177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.187607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1745a8-ef8f-4fd1-acb1-78a90dc0cd43 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.239393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.240163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.240534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.240916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.241835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] RBAC: Adding query filter params (role.id=c7af1985884c4d939727628fc6a7963e, user.id=2d4ceb176fcb404da4cd5a2897359df3, scope.system=all) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:47.242258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.244456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.256805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 182/364] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/role_assignments?user.id=2d4ceb176fcb404da4cd5a2897359df3&scope.system=all&role.id=c7af1985884c4d939727628fc6a7963e => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:47.260372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7e4b-7ffc-4c46-84d2-0cad92c63d8a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.263996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.327533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.328095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.328374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.328642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.391542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.400030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26debff-0917-4d5b-86ec-b2b8d442871e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.427311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.447859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.448626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.448937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.449160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.452885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.454716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.464908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:47.470331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:47.471364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:47.472183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:47.476292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 183/365] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:47.477226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.571265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 183/366] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:47.572607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.597319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ea18-64df-413e-87ec-a4d65e136958 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.636107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.636747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.637023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.637290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.648573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:47.655559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:47.656470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:47.657258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 184/367] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:47.657903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.667015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.680245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.689504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1a99-c354-4be8-b069-51976472ccc3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.730286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.731376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.731949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.732418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.733334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:47.733855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.735654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.746238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 184/368] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:47.747496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.773611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5d015-75e9-4eb4-b50d-e0db15a58e4b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.811833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.812443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.812718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.812985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.815055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.816559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.818262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 185/369] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:47.819463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.860440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e4152-9f1e-4cd9-ace0-5ecbe5a66c99 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.898132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.899162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.899643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.900111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:47.900968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:47.901465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:47.903152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:47.908651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.910822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:47.915390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 185/370] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:47.916409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:47.934386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc304de-0373-4f98-8c10-a794e59b7846 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:47.971395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:47.972005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:47.972283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:47.972555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.029869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486a3c-e433-4e0a-a2ed-d93ad2586ac2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.048497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.050550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.069278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.070150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.070532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.070976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.072208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.074085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.075843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 186/371] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:48.076817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.146972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.167948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 186/372] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:48.169224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.180031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.199920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabbc7-8224-4ae5-833c-09cbe72a563b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.239017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.239674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.240015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.240308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.278001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d60cf-a670-428e-b210-bed8a4538a4a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.316746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.318214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.321953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.322601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.322896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.323165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.323891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=14b822d77c064c1bbcd0377c0aed4241) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:48.324196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.325615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.332618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 187/373] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=3a794b68c0934063ac3400ead0e17439 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:48.333422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.409031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.411206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.441001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 187/374] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:48.447491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.510997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b37f06-305e-4298-81e6-378c396ad542 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.560737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7b0c-de04-4a40-96be-7adb0be6b9e2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.600415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.601170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.601456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.601731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.603083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.603188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.603768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.604046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.604318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] PATH_INFO: `/v3/projects/4794a120bdce4ac9a7db206c3d083bb7` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.604537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.605445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=4794a120bdce4ac9a7db206c3d083bb7)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.606201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 188/375] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:48.606951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.608921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 188/376] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/projects/4794a120bdce4ac9a7db206c3d083bb7 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:48.614446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.614608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.656838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.724653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bb84-2bc8-4bc9-b708-c37d45600ea5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.761278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.761930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.762219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.762503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] PATH_INFO: `/v3/groups/f491fc7d55524b1fa18bce7c388ba292` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.768762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] RBAC: Authorizing `identity:get_group(group_id=f491fc7d55524b1fa18bce7c388ba292)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.770220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.777698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 189/377] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/groups/f491fc7d55524b1fa18bce7c388ba292 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:48.778616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.780708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6edf5-df10-4167-b10e-c744b10c98ee None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.803468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.847854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.848515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.848799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.849076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.850206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.851713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.853645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 189/378] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:48.859472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:48.889869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b24aa-b97b-473e-96f7-2d80b35792ae None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:48.902960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:48.938439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:48.939258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:48.939607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:48.939973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:48.940767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] RBAC: Adding query filter params (group.id=f491fc7d55524b1fa18bce7c388ba292, role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=4794a120bdce4ac9a7db206c3d083bb7) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:48.941143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:48.942779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c301f-6118-42a5-91c1-df9b042b9aaa None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:48.949298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 190/379] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/role_assignments?group.id=f491fc7d55524b1fa18bce7c388ba292&scope.project.id=4794a120bdce4ac9a7db206c3d083bb7&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:49.001224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54545ed9-92e9-4877-a55d-f1660a0705c0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:49.044127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:49.044761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.045048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.045327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.046068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=14b822d77c064c1bbcd0377c0aed4241) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:49.046377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:49.047877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455094-63dc-42d5-9e35-04e4b443d254 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:49.054464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 190/380] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:48 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=072aae4a92604daca4ad778a1b442950 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:49.260376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3c2a-68ae-49ea-96b3-f7f35f79c815 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.260854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3c2a-68ae-49ea-96b3-f7f35f79c815 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.260854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3c2a-68ae-49ea-96b3-f7f35f79c815 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.262368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 191/381] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:49.272449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775614-bbcb-4a7d-a4d9-3c8fe1e5dc2b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.272740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775614-bbcb-4a7d-a4d9-3c8fe1e5dc2b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.273022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775614-bbcb-4a7d-a4d9-3c8fe1e5dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.295714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-18775614-bbcb-4a7d-a4d9-3c8fe1e5dc2b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:49.296929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-18775614-bbcb-4a7d-a4d9-3c8fe1e5dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:49.367343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:49.391450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 191/382] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:49.483728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae193c-49c6-4c7f-bad4-fffcfe1e1d74 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.484041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae193c-49c6-4c7f-bad4-fffcfe1e1d74 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.484281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae193c-49c6-4c7f-bad4-fffcfe1e1d74 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.485873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 192/383] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:49.491343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.491630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.491904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.513129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:49.514260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:49.605710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 192/384] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:49.763246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae193c-49c6-4c7f-bad4-fffcfe1e1d74 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:49.883809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae193c-49c6-4c7f-bad4-fffcfe1e1d74 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:49.921018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:49.921648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:49.921927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:49.922201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:49.934094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:49.938975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:49.939846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:49.940649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 193/385] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:49.946770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:49.975608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.016898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:50.111030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715e5ee-f51c-499b-827d-a12f4cf2912f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.121166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:50.158483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abbc1c-0ed7-4718-b06f-16b76bc10d56 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.172174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.172799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.173080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.173357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.174043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:50.174345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.175762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.191158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 193/386] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:50.198370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.221411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.222647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.224253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.224729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.245809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:50.254722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:50.255586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:50.256368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:50.260866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 194/387] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:50.275692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.387947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91ac9-cb9d-4704-a1f1-45a24d3decd9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.426931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:50.451688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09970bfa-1217-45e2-83b4-cfbbbe6988e9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.454781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.455429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.455715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.455985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.457873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.459759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.467096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 194/388] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:50 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:50.475786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.526380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.528818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.529283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.529700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.530546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:50.531951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.533518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.546882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:50.555452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 195/389] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:50.563064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.677018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487be63-f757-42a6-bfe7-467df8b4d392 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.678037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527a5b-410d-46c1-9139-28f66fb37fe2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.715653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.716657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.717137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.717673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.719135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.720563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e396881-cee0-4e91-93db-7fbbbb662667 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.722258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 196/390] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:50 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:50.723281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9378-a2e1-4464-aa3a-fa30236b5f78 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.723635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9378-a2e1-4464-aa3a-fa30236b5f78 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.723912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9378-a2e1-4464-aa3a-fa30236b5f78 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.725368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 197/391] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:50.729740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9378-a2e1-4464-aa3a-fa30236b5f78 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.743099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.744145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.744768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.745219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.746777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.749091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0979136-5026-45e3-84b6-2ca5eb7023fd None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.751756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 195/392] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:50 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:50.753618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.754192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.754852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.755009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:50.781776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:50.783515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:50.853353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9378-a2e1-4464-aa3a-fa30236b5f78 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:50.870260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 196/393] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:50.875467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.895563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:50.896594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:50.896893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:50.897170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:50.899050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:50.900493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:50.903132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 198/394] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:50 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:50.912656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:50.941849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:51.019868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c48a-8463-4f1e-9f2c-d633df81b754 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:51.035056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:51.057366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:51.058042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.058322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.058620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/groups/88aeec69f7864e46924dee2f2819c1fc/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.065256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, group_id=88aeec69f7864e46924dee2f2819c1fc, role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:51.066742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:51.072023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2b322-4b78-404e-be16-6c25b20392c4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:51.090293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 197/395] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 19 02:11:50 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/groups/88aeec69f7864e46924dee2f2819c1fc/roles/072aae4a92604daca4ad778a1b442950 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:51.141783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:51.142824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.143267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.143681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88/groups/88aeec69f7864e46924dee2f2819c1fc/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.149728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=6e178654f0164832bb497d0217f65a88, group_id=88aeec69f7864e46924dee2f2819c1fc, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:51.151376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97e9df-0772-43cb-9dbc-02b7b5a4a5ff None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:51.176821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 199/396] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 19 02:11:50 2022] PUT /identity/v3/projects/6e178654f0164832bb497d0217f65a88/groups/88aeec69f7864e46924dee2f2819c1fc/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:51.373056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:51.480362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee03c-667b-4b2c-bdd5-5cd050a6e422 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.481190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee03c-667b-4b2c-bdd5-5cd050a6e422 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.481300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:51.481720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee03c-667b-4b2c-bdd5-5cd050a6e422 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.484639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 200/397] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:51.488437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b87-585c-4fba-ad23-b353ea679de7 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:51.490319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bab2-e9aa-4770-8354-6fcd1118aadc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.490835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bab2-e9aa-4770-8354-6fcd1118aadc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.491338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0bab2-e9aa-4770-8354-6fcd1118aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.519935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-86d0bab2-e9aa-4770-8354-6fcd1118aadc None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:51.521142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-86d0bab2-e9aa-4770-8354-6fcd1118aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:51.550357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:51.551062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.551376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.551659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.568736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:51.574150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:51.575046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:51.576256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 198/398] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:51.582923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:51.652357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 201/399] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:11:51.702833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963d09-d716-4489-be8f-34e3fa3a87ff None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.703194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963d09-d716-4489-be8f-34e3fa3a87ff None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.703534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963d09-d716-4489-be8f-34e3fa3a87ff None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.704999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5b2-8239-48dc-9f7e-2dd9b37c8a5b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:51.705230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 202/400] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:51.710903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.711188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.711506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.733357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:51.734646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:51.757376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:51.759045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:51.759537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:51.759997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:51.760847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] RBAC: Adding query filter params (name=member) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:51.761336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:51.762935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:51.782112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 199/401] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:51.787973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:51.809123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 203/402] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:51.836723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:51.954331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44a36c-6dac-4148-a690-8124d2cb278f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:51.999814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.000824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.001294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.001751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.003109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.004750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.006536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 200/403] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:51 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:52.013279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.015849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.122041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.190210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514046e-e3ad-4317-ab21-03489c7879a8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.236725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.237734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.238213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.238961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.241588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.243630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.245568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 204/404] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:52.246357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.252240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.273702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e331-d7eb-4553-931d-29e98e7f19bf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.325042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.325680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.325960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.326233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.335531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.337481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:52.342248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:52.343164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:52.343952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 201/405] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:52.344588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.373645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce355-6db0-44a0-b846-3439262be41c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.407735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.408731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.409367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.409839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.421365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:52.427083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:52.427948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:52.428778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:52.431933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 205/406] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:52.432972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.453569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398147-bf29-4244-8dde-ad800449c620 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.491800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.492385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.492733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.493011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/groups/88aeec69f7864e46924dee2f2819c1fc/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.495352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, group_id=88aeec69f7864e46924dee2f2819c1fc, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.496904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.520896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 202/407] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 19 02:11:52 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/groups/88aeec69f7864e46924dee2f2819c1fc/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:52.520896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.526964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.591800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4665-090a-4007-810a-c0a3eba94d99 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.661390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.676067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.677934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.678420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.678917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.679803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:52.680371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.682043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.694634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 206/408] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:52.700359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.722055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b49977-ba10-465f-bfe3-e54a732ef5db None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.767915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.768829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.769319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.769786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.770704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:52.771202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.772873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.782598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 203/409] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:52.799064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.875825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d54412-9de5-4de4-a875-24ce5dede2de None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:52.916407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:52.917403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:52.917878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:52.918344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] PATH_INFO: `/v3/groups/f491fc7d55524b1fa18bce7c388ba292` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:52.919779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] RBAC: Authorizing `identity:get_group(group_id=f491fc7d55524b1fa18bce7c388ba292)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:52.921444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:52.923665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 207/410] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/groups/f491fc7d55524b1fa18bce7c388ba292 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:52.929895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:52.937380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:52.986712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257b115-685b-4c52-8f8b-e1408528bdf2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:53.021493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:53.022371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.022857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.023266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.025078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:53.026741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:53.028795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 204/411] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:53.034974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:53.052133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:53.099335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ecccb-0cb2-46e4-83d0-3235a888fc6a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:53.135504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:53.136405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.136813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.137217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] PATH_INFO: `/v3/projects/4794a120bdce4ac9a7db206c3d083bb7` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.138606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] RBAC: Authorizing `identity:get_project(project_id=4794a120bdce4ac9a7db206c3d083bb7)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:53.140242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:53.146685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 208/412] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:52 2022] GET /identity/v3/projects/4794a120bdce4ac9a7db206c3d083bb7 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:53.148666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:53.254732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca900f-e5c1-430f-94aa-daa8ae2f0b3c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:53.282675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:53.292362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:53.293333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.293749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.294158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] PATH_INFO: `/v3/projects/4794a120bdce4ac9a7db206c3d083bb7/groups/f491fc7d55524b1fa18bce7c388ba292/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.296271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] RBAC: Authorizing `identity:create_grant(project_id=4794a120bdce4ac9a7db206c3d083bb7, group_id=f491fc7d55524b1fa18bce7c388ba292, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:53.297854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:53.310810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1354f-3744-439d-b674-294959f80e51 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:53.320066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 209/413] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 19 02:11:53 2022] PUT /identity/v3/projects/4794a120bdce4ac9a7db206c3d083bb7/groups/f491fc7d55524b1fa18bce7c388ba292/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:53.379021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:53.379686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.379971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.380251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.387561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:53.389079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd32ce-bee9-4007-b922-4d4599b46831 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:53.391231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 205/414] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:53 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:53.397188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:53.536536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e23ee-4d3b-424d-a898-b2eed0220a65 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.537018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e23ee-4d3b-424d-a898-b2eed0220a65 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.537018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e23ee-4d3b-424d-a898-b2eed0220a65 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.538481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 206/415] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:53.540926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69975-cc2d-45ac-a4c7-4c2734fca203 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.541203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69975-cc2d-45ac-a4c7-4c2734fca203 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.541478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69975-cc2d-45ac-a4c7-4c2734fca203 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.542966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 207/416] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:53.547423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.547716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.547994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.555899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf791c-5e3d-4229-aa08-107f148f0555 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:53.558973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:53.571519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:53.572756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:53.595718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:53.597075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.597547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.598011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241/groups/88aeec69f7864e46924dee2f2819c1fc/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.600393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] RBAC: Authorizing `identity:create_grant(project_id=14b822d77c064c1bbcd0377c0aed4241, group_id=88aeec69f7864e46924dee2f2819c1fc, role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:53.602113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8ad34-029a-41a6-9a7c-96889f1c6465 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:53.618394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 210/417] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 19 02:11:53 2022] PUT /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241/groups/88aeec69f7864e46924dee2f2819c1fc/roles/072aae4a92604daca4ad778a1b442950 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:11:53.620066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:53.620595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:53.621132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:53.645046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:53.647472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:53.706204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:53.710696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 208/418] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:53.746908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 211/419] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:54.032841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.056652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.157154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed290e0-a81c-4923-a789-6ed8adfb9639 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.194480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:54.205853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32417c6-78ff-4d6c-af26-f8700850ab5e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.209163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.209163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.209359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.209902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.226701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:54.239472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:54.240441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:54.241228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:54.245693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 209/420] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:54.253211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.259534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.260553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.260939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.261317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.281859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:54.287279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:54.288122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:54.288992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:54.295061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 212/421] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:54.296018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.365058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9a55-3775-48e2-b82f-53f2edcdfc75 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.402930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:54.411880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.412505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.412807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.413063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.413738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:54.414044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:54.415982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:54.439024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 210/422] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:54.444691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.472204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358f86-53f1-4714-b550-0ac3d073298d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.542026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.542558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.542863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.543136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.543806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:54.544110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:54.545496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:54.550882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:54.564432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 213/423] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:54.582696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:54.609313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b420c7-0dcc-40e4-9b6a-c2fa4103cd71 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.654188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.654833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.655111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.655380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.747137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:54.750965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee36e-d318-473b-bd6b-bcacf513d102 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:54.751315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:54.753797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c73e-b8f3-4c77-ac0b-433265a6bf85 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:54.801725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:54.802671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.802953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.803244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.815154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:54.863458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 211/424] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:54.864954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64412a-a2a4-4251-92b9-07d8f272e906 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.865404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64412a-a2a4-4251-92b9-07d8f272e906 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.865826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64412a-a2a4-4251-92b9-07d8f272e906 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.871774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 212/425] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:54.873048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:54.873484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:54.873905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:54.891775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:54.893247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:54.893362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:54.897148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:54.976777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 213/426] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:54.977667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.006030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.012021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 214/427] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:11:55.029334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.077417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.100368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865c62f-b544-4ac2-92bb-3331907a40a3 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.160812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.161851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.166619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.166619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.166619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.166619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.167417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 214/428] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:54 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.173403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.268585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d367ed-0aa5-4c22-babe-c4bd2ad442bc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.280974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead210b2-8d13-46c7-be04-5ce0b843fac8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.317313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.318242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.318526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.318827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.319932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.321836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.327807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 215/429] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:55.329703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.355690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.376447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.377092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.377401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.377662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] PATH_INFO: `/v3/projects/6e178654f0164832bb497d0217f65a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.378835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e178654f0164832bb497d0217f65a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.380332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.382240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 215/430] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/projects/6e178654f0164832bb497d0217f65a88 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.387207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.444202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf75f-659f-4923-9be3-9f9cc093868c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.471299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.482362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.483136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.483424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.483700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.484488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=6e178654f0164832bb497d0217f65a88) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:55.484908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.486463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.493744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 216/431] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=072aae4a92604daca4ad778a1b442950 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.494643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.515464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abca4a-4f83-4483-a928-78be533452c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.555772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.556428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.556710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.556987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.569755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a4de7031-5b70-46e0-b42b-3386f6e1a153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:55.575373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:55.576373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:55.577205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 216/432] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:55.578468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda374-917c-4280-bf45-b958a5d50748 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.578468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda374-917c-4280-bf45-b958a5d50748 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.578845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda374-917c-4280-bf45-b958a5d50748 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.584856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 217/433] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:11:55.585847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda374-917c-4280-bf45-b958a5d50748 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.620136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.638341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aefe94-ca49-406b-a4f3-48976f1ecc26 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.678232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.678899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.679187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.679462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.681111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.682589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd464d4-5d0c-4436-a564-3c03e8700609 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.684453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 217/434] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.685583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.685865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.686152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.707112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:55.708435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:55.735704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda374-917c-4280-bf45-b958a5d50748 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.765320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.774268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.774917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.775200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.775480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.776142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:55.776448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.777821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.786517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 218/435] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.790317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 218/436] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:55.795866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.797202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:55.902373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16460-4d77-4906-ba91-ddd6fdbfc7ba None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.908695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:55.936994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19347067-3342-4a8a-b286-03dde0da18c7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:55.939213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.939924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.941007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.941007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.941428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=6e178654f0164832bb497d0217f65a88) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:55.941828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:55.943353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9476b6-fc1b-4526-81d3-111371caacca None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:55.951740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 219/437] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=6e178654f0164832bb497d0217f65a88&role.id=3a794b68c0934063ac3400ead0e17439 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:55.978601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:55.979523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.979947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.980371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.986156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85a78d-38b7-4ffc-aa85-09a1b8fdd406 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.986440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85a78d-38b7-4ffc-aa85-09a1b8fdd406 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.986774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85a78d-38b7-4ffc-aa85-09a1b8fdd406 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:55.992400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 220/438] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:11:55.994405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:55.994655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:55.994932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.017627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:11:56.020166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:11:56.064952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.068443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.083235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.105223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 221/439] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:11:56.106072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.157266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.183997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 219/440] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:56.189926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.231751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdb410-5dad-4cb9-a0e9-3470d31e40f9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.275951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.276949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.277402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.277867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.289044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:56.294019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:56.294926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:11:56.295711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:11:56.297023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 222/441] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:56.301532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.325897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5b54-3032-4243-960f-72f61852fb01 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.357264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.372371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.373094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.373323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.373562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.374844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.376214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.378001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 220/442] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:56.384084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.422559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a069-00fb-4768-a703-cfdb96be3a22 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.434316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.463598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.464212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.464943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.465226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.465904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:56.466589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.467987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.476989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 223/443] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:56.478325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.494230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3d64b-e502-4b92-b0bb-9ff48c2633fb None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.532759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.533412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.533702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.534393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.545718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:11:56.552431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:11:56.553334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 221/444] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:11:56.554749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.605426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35735766-eb6a-4246-87a2-d7b059227bfd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.612556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.639853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.640472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.640746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.641017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.642118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.643583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.645128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 224/445] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:56.645875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.662301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed76747-f6bf-4838-b22a-13b6e2cd1c04 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.672361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.695430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.696506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.696785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.697058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.741759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98d8d-b47e-49d8-92b4-828afc3c620a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.763375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.764825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.775245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.775843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.776112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.776395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.777047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:56.777351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.779014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.786707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 225/446] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:56.787484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.821225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.864196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 222/447] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:56.865047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.876520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:56.887649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475463d7-d5e1-4861-8be4-1072ffc51ffc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:56.922058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:56.922683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:56.922964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:56.923235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:56.923950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=3a794b68c0934063ac3400ead0e17439, scope.project.id=14b822d77c064c1bbcd0377c0aed4241) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:56.924256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:56.925680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:56.931990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 226/448] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=3a794b68c0934063ac3400ead0e17439 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:56.932558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:56.970059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85ec7b-57d4-45d3-94ee-c60fe1c506bb None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.014431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.015075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.015358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.015654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.045802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:57.050149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933bca-4075-40f2-a779-9bebbb6f5d6a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.092621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.093259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.093541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.095552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] PATH_INFO: `/v3/projects/4794a120bdce4ac9a7db206c3d083bb7` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.095552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] RBAC: Authorizing `identity:get_project(project_id=4794a120bdce4ac9a7db206c3d083bb7)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.096483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.098602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.098733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 227/449] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/projects/4794a120bdce4ac9a7db206c3d083bb7 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:11:57.099439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.103956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:57.111064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:57.219400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 223/450] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:11:57.225500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:57.228210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0662-4bd2-4793-9ce8-3829970b986b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.267181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.267818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.268099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.268373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] PATH_INFO: `/v3/groups/f491fc7d55524b1fa18bce7c388ba292` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.269508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] RBAC: Authorizing `identity:get_group(group_id=f491fc7d55524b1fa18bce7c388ba292)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.270981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.272554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 228/451] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:57 2022] GET /identity/v3/groups/f491fc7d55524b1fa18bce7c388ba292 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:57.278425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:57.313936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:57.331525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71f48-b4cf-4b9a-832f-75fb0372c73f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.342925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:57.367445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.368648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.368925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.369194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] PATH_INFO: `/v3/projects/14b822d77c064c1bbcd0377c0aed4241` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.370297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] RBAC: Authorizing `identity:get_project(project_id=14b822d77c064c1bbcd0377c0aed4241)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.371770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.373414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 224/452] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:11:57 2022] GET /identity/v3/projects/14b822d77c064c1bbcd0377c0aed4241 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:57.378350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a934-a930-46dc-b898-0bb7f5d9fbbc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.378872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:57.411416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.412010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.412292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.412568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.413288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] RBAC: Adding query filter params (group.id=f491fc7d55524b1fa18bce7c388ba292, role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=4794a120bdce4ac9a7db206c3d083bb7) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:57.413599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.415589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.421200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 229/453] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:57 2022] GET /identity/v3/role_assignments?group.id=f491fc7d55524b1fa18bce7c388ba292&scope.project.id=4794a120bdce4ac9a7db206c3d083bb7&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:57.481538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978106-86db-427e-95e8-d0f5d5fda02d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.516463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.517097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.517374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.517640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] PATH_INFO: `/v3/groups/88aeec69f7864e46924dee2f2819c1fc` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.519078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] RBAC: Authorizing `identity:get_group(group_id=88aeec69f7864e46924dee2f2819c1fc)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.520251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be9ee5-2a4d-4d00-bc32-1893260d973e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.521858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 225/454] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 19 02:11:57 2022] GET /identity/v3/groups/88aeec69f7864e46924dee2f2819c1fc => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:11:57.528948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:11:57.626589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:11:57.629647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c197e-2a43-4549-96f1-6235a02d1b1f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:11:57.663062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:11:57.663654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:11:57.663934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:11:57.664206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:11:57.664947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] RBAC: Adding query filter params (group.id=88aeec69f7864e46924dee2f2819c1fc, role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=14b822d77c064c1bbcd0377c0aed4241) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:11:57.665254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:11:57.666692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14684b74-62b7-4aa2-a90d-165c3c51563e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:11:57.672209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 230/455] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 19 02:11:57 2022] GET /identity/v3/role_assignments?group.id=88aeec69f7864e46924dee2f2819c1fc&scope.project.id=14b822d77c064c1bbcd0377c0aed4241&role.id=072aae4a92604daca4ad778a1b442950 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:00.035514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d9c7-1f29-43ae-93d5-0c15442b55f9 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.036389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d9c7-1f29-43ae-93d5-0c15442b55f9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.036810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d9c7-1f29-43ae-93d5-0c15442b55f9 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.038524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 226/456] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:00.044136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13542-6c3d-4e56-ad62-9bdab52c82ba None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.044558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13542-6c3d-4e56-ad62-9bdab52c82ba None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.044885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d13542-6c3d-4e56-ad62-9bdab52c82ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.068464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-93d13542-6c3d-4e56-ad62-9bdab52c82ba None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:00.069787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-93d13542-6c3d-4e56-ad62-9bdab52c82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:00.156800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 231/457] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:00.407001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002646-8ad7-4ea7-8e60-3a5af8f1fbf4 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.407282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002646-8ad7-4ea7-8e60-3a5af8f1fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.407803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002646-8ad7-4ea7-8e60-3a5af8f1fbf4 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.409599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 227/458] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:00.415853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd56b-6098-4f73-a3bb-3b4ca9c08757 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.416358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd56b-6098-4f73-a3bb-3b4ca9c08757 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.416829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd56b-6098-4f73-a3bb-3b4ca9c08757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.435300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-370fd56b-6098-4f73-a3bb-3b4ca9c08757 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:00.436772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-370fd56b-6098-4f73-a3bb-3b4ca9c08757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:00.518883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 232/459] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:00.552167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002646-8ad7-4ea7-8e60-3a5af8f1fbf4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:00.613383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:00.680866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002646-8ad7-4ea7-8e60-3a5af8f1fbf4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:00.709261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36033-cb77-4081-bb10-28f00619b915 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.710136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36033-cb77-4081-bb10-28f00619b915 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.710665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36033-cb77-4081-bb10-28f00619b915 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.716451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 233/460] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:00.717886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.718386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.720298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.725579 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:00.726221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.726523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.726852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.750995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:00.752505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:00.754043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:00.755312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:00.783135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:00.784137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:00.785433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:00.785433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:00.785433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:00.785433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 228/461] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:00.797387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:00.801934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:00.875440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 234/462] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:00.876286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:00.933733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:00.939609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239b8f6-f61d-4df6-ac15-6a8c859e9b7d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:00.976908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:00.978438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:00.979008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:00.979476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:00.980446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:00.981043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:00.982650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ff1d0-3421-4d2b-827c-5c2349a3c320 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:00.997434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 229/463] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:00.999762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef53d-3217-4ae0-b56d-4012b5243e87 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.000304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef53d-3217-4ae0-b56d-4012b5243e87 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.000787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef53d-3217-4ae0-b56d-4012b5243e87 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.002585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 230/464] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:01.005635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ef53d-3217-4ae0-b56d-4012b5243e87 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.009824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6496-4a25-4c46-a928-ef7871945c71 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.048162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.048803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.049029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.049246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.059697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.061307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1484acd4-4dc5-40e6-8efe-b0b49d095f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:01.078289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:01.079266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:01.080086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:01.080086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.080086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:01.084364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 235/465] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:01.085890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.086224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.087220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.100289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.106376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:01.107647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:01.143280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ef53d-3217-4ae0-b56d-4012b5243e87 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.184693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.185242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.185522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.185805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.186437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.187917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.202630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 236/466] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:01.202630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.218608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 231/467] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:01.218608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.229975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.384508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb95ad8-3411-4344-be2e-d3b4e0ae8300 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.424808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b6446-b779-4951-8535-ddb8f1218198 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.427064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.428299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.428418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.428627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.429324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:01.429630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.432355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.434170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.450032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 237/468] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:01.451068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.469730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.470752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.471253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.471805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.485713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.487322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:01.501733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:01.502954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:01.503787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:01.503787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.503787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:01.503787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 232/469] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:01.504006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.578291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4afcc2-b420-433a-bfc3-2b9b981a3d25 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.593881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.622894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.623506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.623794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.624071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.624720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.626156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.636753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62a26-1451-4904-9994-2cf807a902e1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.647991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 238/470] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:01.649031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.680953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.681761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.682049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.682321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.695290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.697521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.711878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-41888396-bf77-42d4-ad03-a06a94480227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:01.715665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:01.716789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:01.717726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:01.717726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:01.717726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:01.717726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 233/471] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:01.718085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0020b9-2436-442a-8938-8b5fd1faddb4 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.726676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0020b9-2436-442a-8938-8b5fd1faddb4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.726676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0020b9-2436-442a-8938-8b5fd1faddb4 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.726676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 234/472] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:01.730217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0020b9-2436-442a-8938-8b5fd1faddb4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.782442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f715-58d5-4dbd-ba5f-ebbbe738236b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.820436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.821926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.822435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.822835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.823580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:01.823980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.825510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04445a6b-a1d5-4584-a868-8b4150af83b8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.840403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 239/473] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:01.841749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.842134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.842508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.851056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0020b9-2436-442a-8938-8b5fd1faddb4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:01.865881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:01.867147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:01.874825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:01.894834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:01.895554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:01.895835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:01.896101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:01.896745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:01.897099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:01.899368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:01.912502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 235/474] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:01.914132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.947178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 240/475] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:01.948049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:01.995199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:02.058994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642627e-415f-44d8-854f-300f9e96ba09 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:02.108698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:02.109490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:02.109774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:02.110051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:02.110719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:02.112239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:02.119364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06058ac-9874-4169-a5ce-dfb817841c24 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:02.150096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 241/476] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:02.162491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:02.163189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:02.163411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:02.163681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:02.164364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:02.165828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:02.199166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 236/477] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:01 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:02.277662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:02.400528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:02.404041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0129-2117-4567-b24b-0d87694201e8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:02.444225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:02.444835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:02.445113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:02.445382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:02.446123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:02.447510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:02.455715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.sql.core [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 02:12:02.455715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 02:12:02.455715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [parameters: {'id': '2bb18e849da94fc485b6cb548d384c4d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 02:12:02.455715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81527) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:02.472763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return ref.to_dict() Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:02.473690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application yield resource Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise self.value Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application session.commit() Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 02:12:02.474627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.flush() Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application compat.raise_( Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 02:12:02.475911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:02.477845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:02.478704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [parameters: {'id': '2bb18e849da94fc485b6cb548d384c4d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:02.479830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 02:12:02.480802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:02.481791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 242/478] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 19 02:12:02 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:02.481855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:02.518106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:02.591246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cf4e4-c15a-449f-840d-26672a61eaf6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:02.626455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:02.627114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:02.627390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:02.627657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:02.638462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b66a4a20-5dc4-45f5-af33-bc358ed007f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:02.643379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:02.645439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:02.646609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 237/479] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:02.650788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:02.760185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31173b-083a-4577-a8c0-a2388a0582fc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:02.793944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:02.794546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:02.794857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:02.795126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:02.795781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:02.796078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:02.797427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda5e12-8eff-41be-9ac8-121631b3ae20 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:02.805772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 243/480] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:03.569588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5929-0884-4098-8787-13408617ef64 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:03.570589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5929-0884-4098-8787-13408617ef64 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:03.571108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5929-0884-4098-8787-13408617ef64 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:03.572882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 238/481] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:03.578416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05207cb-564b-4764-8189-32c49ceb3e63 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:03.579248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05207cb-564b-4764-8189-32c49ceb3e63 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:03.579722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05207cb-564b-4764-8189-32c49ceb3e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:03.598451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e05207cb-564b-4764-8189-32c49ceb3e63 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:03.600024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e05207cb-564b-4764-8189-32c49ceb3e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:03.621002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:03.696583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 244/482] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:04.083313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6eee7-b800-4cf9-82e3-c8b7959b0d7f None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.083637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6eee7-b800-4cf9-82e3-c8b7959b0d7f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.083979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6eee7-b800-4cf9-82e3-c8b7959b0d7f None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.085855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 239/483] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:04.091625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.092124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.092597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.105337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6eee7-b800-4cf9-82e3-c8b7959b0d7f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.119553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:04.121035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:04.227971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:04.236678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6eee7-b800-4cf9-82e3-c8b7959b0d7f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:04.278644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 245/484] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:04.283259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:04.283913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.284315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.284589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.295479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:04.300471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:04.301348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:04.302149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:04.306583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 240/485] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:04.311681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.439498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:04.458121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246be8-1c3f-4ea7-ae7b-6a56ecf64e63 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:04.507428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:04.508101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.508882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.509156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.509849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:04.510122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:04.511514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:04.525982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 246/486] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:04.531591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.623355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.659029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8c35d-97d3-4c87-9330-15d275296162 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:04.706363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:04.707181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.707474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.707751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.722141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:04.723889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b37df547-5ec9-442f-9b35-e49262345644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:04.743374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:04.744302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:04.745526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:04.745526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:04.745526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:04.745526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 241/487] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:04.746845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f25b-b1bb-422e-9364-6ce170a479a5 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.746845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f25b-b1bb-422e-9364-6ce170a479a5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.746845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f25b-b1bb-422e-9364-6ce170a479a5 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.747849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f68d99-1e0c-4030-9bcf-ce582fc6d38c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:04.747966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 242/488] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:04.752715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6f25b-b1bb-422e-9364-6ce170a479a5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.762806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:04.794764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:04.795402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.795685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.795960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.810413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6a9712a1-9903-4d7e-9307-117a6eb4c542 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:04.817875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:04.818829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:04.819627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 247/489] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:04.820920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.822328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.822851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.837741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:04.842746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:04.843941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:04.866133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6f25b-b1bb-422e-9364-6ce170a479a5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:04.906364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:04.907306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.907592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.907868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.908772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:04.909095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:04.910981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21a95-6441-492b-b11f-5284242c0ba4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:04.923132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 248/490] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:04.923132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:04.923382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 243/491] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:04.924399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e3c7-6b00-4634-9222-ad0e4b41447e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:04.924969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e3c7-6b00-4634-9222-ad0e4b41447e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:04.925246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e3c7-6b00-4634-9222-ad0e4b41447e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:04.926609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 244/492] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:04.928190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9e3c7-6b00-4634-9222-ad0e4b41447e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.006588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.033127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de6ad-3fb5-4585-ac81-8f29ef948387 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.045983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9e3c7-6b00-4634-9222-ad0e4b41447e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.069524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.070126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.070406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.070739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.071410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:05.071709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.073288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384163e7-7744-4964-9dcb-7a62230c2c71 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.075495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.083429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 249/493] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:05.085170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.085354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.085767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.086189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.086381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.086679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.087045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.095651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.096719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.107095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:05.108505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:05.111090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:05.112005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:05.112905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:05.117125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 245/494] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:05.118725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.193872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 250/495] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:05.195060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.238833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc3c9-af3d-4c2b-8ef9-b20a7bb457a4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.264741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.274278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.275583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.275583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.275583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.287024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.288596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:05.302982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:05.303898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:05.304727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:05.304727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:05.304727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:05.304727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 246/496] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:05.306306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.310467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66c67-a1cb-4c6c-a93b-9bb8a90f50b1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.339221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.348763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.349625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.350064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.350489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.351375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:05.351864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.353463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.392704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 251/497] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:05.393856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.415384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb023-6f53-43f5-ba84-74ee6cf9b010 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.452561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.453281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.453564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.453837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.465245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:05.470657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:05.471550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:05.472344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 247/498] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:05.472998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.502686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30de3-2458-4176-a64a-f5cd2d710fee None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.513196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.536857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.537390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.537668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.537939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.538642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:05.538892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.540769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4964-312d-431b-aae8-bb69cb5156be None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.552397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 252/499] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:05.553597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce319e2-36df-440f-a068-fc9743b6121f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.553886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce319e2-36df-440f-a068-fc9743b6121f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.554204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce319e2-36df-440f-a068-fc9743b6121f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.555970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 253/500] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:05.556665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce319e2-36df-440f-a068-fc9743b6121f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.576975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce9a27-effa-4237-91a3-756d588b5f5b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.604095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.613211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.613811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.614089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.614357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.656960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce319e2-36df-440f-a068-fc9743b6121f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.680542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.682008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.690591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.691233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.691512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.691786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.701622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:05.706304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:05.707244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:05.708024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 254/501] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:05.708674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.722961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.783090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 248/502] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:05.783909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.811267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b198-f2cf-4630-9d93-6db96591f256 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.818592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.845681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.846287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.846586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.846874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.847533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:05.847840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.849216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e17a45-653b-4bc4-a596-0e67956d6071 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.857403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 255/503] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:05.858602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.858959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.859239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.877793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:05.879051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:05.885688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd8637-f561-4ea4-839c-eb7f8b17a260 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:05.926407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:05.927086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:05.927472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:05.927751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] PATH_INFO: `/v3/users/glance` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:05.935601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:05.937039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:05.938749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:05.944727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 256/504] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:05.945666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:05.949458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:05.950589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 249/505] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:05.951480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.052638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.056683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ef1df-fda3-41d2-8f87-2cae931f73a6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.061884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a88b7-aa8c-4f37-b519-85fb31ba4bca None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.092014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.092620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.092919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.093164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.093811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:06.094110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.095495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.096805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.097422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.097860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.097978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.108861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 257/506] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:06.108861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.113716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.115213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:06.130046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:06.131142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:06.132151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:06.132151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.132151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:06.132151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 250/507] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:06.136233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.198094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.225028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920fe6-d57d-49fc-9a0d-9da06ba228c2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.250265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8f27f-d36c-4f48-9786-7be1df682175 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.258238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.258896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.259178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.259450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.269586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.271054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.283162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.283788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.284066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.284333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.285054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:06.285361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:06.286087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:06.287095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:06.293213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:06.293213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.293213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:06.293406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.293487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 258/508] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:06.293487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.308011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.324257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 251/509] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:06.328281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.392167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5167-1146-4113-aff7-ac9272a12216 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.424848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.425462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.425747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.426017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.426554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4ebcd-64f7-470b-a774-5cd339f7f5bf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.436398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.436964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.437845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:06.452135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:06.453191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:06.454011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:06.454011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.454011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:06.454011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 259/510] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:06.454011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.465697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.466309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.466613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.466891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.467534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:06.467836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.469215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.480430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 252/511] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:06.481228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.518899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.556584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631a7b6-3677-4794-b4b7-26384edb71f3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.582221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26844f8-4373-4114-8db3-e98be26b6deb None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.591375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.592003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.592285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.592563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.603056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.604508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.615289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.615889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.616169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.616442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.617078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:06.617407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.618801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:06.618891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:06.619919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:06.620753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:06.620753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:06.620753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:06.620753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 260/512] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:06.620753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.632168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 253/513] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:06.633496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.660604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.721142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377da67-347b-4b65-b80c-3c73389926e5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.730890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad307e5-71b5-40f6-ba0c-1b48673b5249 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.736980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.755180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.755780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.756059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.756331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.765373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.765972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.766251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.766524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.767182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:06.767479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.768866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.779877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 254/514] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:06.780660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.823501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.824956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.866548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:06.879147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4c1a4-2e2f-498d-8e03-7795f7612191 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:06.911591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:06.912204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:06.912475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:06.912747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:06.919272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:06.919460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 261/515] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:06.920323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.920735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:06.934932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:06.935954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:06.936955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 255/516] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:06.937514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:06.939969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.019369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd3bf-c9fa-4687-8325-8392d1628f94 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.035389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91b76-716f-4fa5-9cd0-b266c996733e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.052556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.053164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.053445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.053721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.054413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.054745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.056160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.066969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 262/517] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.067739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.068471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.069096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.069432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.069715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.078027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.079511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:07.091300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:07.092166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:07.093034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 256/518] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:07.093587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.103735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.148169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.177262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95259fb-e89f-4172-8759-70e3d5297aa6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.193955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45759b0-e185-4fd9-87c3-fc0a11210927 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.210437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.211084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.211358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.211622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.219043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.220473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.226361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.227550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.227828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.228096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:07.232811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:07.233858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 263/519] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:07.235051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.239585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.241040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:07.255544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:07.256518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:07.257369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:07.257369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:07.257369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:07.257369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 257/520] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:07.257369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.312848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.333945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5975-fe23-4025-bf93-235fc0feb854 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.353373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f8f21-c302-4eda-be39-721f94ba3342 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.367007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.367625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.367901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.368173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.368857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.369387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.370595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.374412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.386236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.386858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.387134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.387684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.388312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.388481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 264/521] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.389276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.389866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.410664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 258/522] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:07 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:07.411456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.515310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e34dd-a56b-4579-ad13-04b841f17f83 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.528053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079d142-e488-4090-bc76-13d46a327365 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.546600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.556205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.557415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.557415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.557415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.558136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.558447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.559987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.571941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.572557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.572871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.573409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.573821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.574624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.576141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.578238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 265/523] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.579096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.596491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 259/524] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.597411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.638940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.685692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a097dd-d74d-4fcd-bbe4-81c45470817d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.712406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046297-16bf-4ec1-8024-fd4a710c21e8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.722624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.723224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.723504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.723775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.724482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.724701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.726069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.738788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 266/525] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.740245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.749048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.749658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.749938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.750196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.750943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:07.751367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:07.752819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:07.759092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 260/526] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:07.759721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:07.818473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.876310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0b00-89ac-417e-8ed1-e8094cb7a4c7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.893043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:07.917757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc24f2-8f9f-4338-83b8-b487c2a15f51 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:07.920264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.920998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.921378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.921747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:07.959157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:07.960307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:07.960777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:07.961504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.001354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.003186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.035984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.037572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.077633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.111020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 267/527] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:08.112142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.131059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.155126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 261/528] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:08.156153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.218609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774af4c-0d57-49a1-9fdb-1b8aac5be12c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.261985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.262651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.262936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.263214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.272302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.274450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.277561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f360-0d3a-4101-a30e-ed3ccb90e9df None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:08.289991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:08.291006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:08.291883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 268/529] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:08.292442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.316983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.317837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.318258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.318717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.326290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.331831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.333500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:08.349943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:08.350952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:08.351867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:08.351867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:08.351867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:08.353792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 262/530] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:08.354718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.388604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.422602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc4ee6-4dc8-4e74-a4bd-8727d0f85064 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.459324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.460544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.461557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.462049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.462989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eae1b-cc16-47ee-8239-8c5eb6cb5a68 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.473412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.475157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:08.490104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:08.491076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:08.492047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:08.492047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:08.492047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:08.494014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 269/531] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:08.495007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.500950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.501618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.501900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.502172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.502951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:08.503256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.504768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.529526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 263/532] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:08.530294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.587051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.604316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959e51-6bfe-4290-a411-a1ef1eadaa72 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.630284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.640610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.641292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19f25e-176d-4cac-bb5d-0331260b2cc1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.641707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.642177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.642686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.643534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:08.644021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.645567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.662806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 270/533] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:08.663893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.678184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.678837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.679150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.679430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.680103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:08.680403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.681827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.693874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 264/534] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:08.694450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.768272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2447d-845b-44c4-a33b-2445d607af85 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.801554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bd44-c2e3-4ef3-91b9-39c8980440d8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.805080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.805949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.806436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.806947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.807886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=18fe513fdeb442c6bbd2e2144169ba78) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:08.808397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.810139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.812547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.817269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 271/535] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/role_assignments?user.id=18fe513fdeb442c6bbd2e2144169ba78&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:08.818367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.864317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.864981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.865267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.865544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:08.878077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:08.878547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:08.879651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:08.907922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:08.908840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:08.909658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 265/536] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:08.918500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:08.943889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d052-6b48-487d-a824-a306354984ab None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:08.994273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:08.995315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:08.995788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:08.996246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.016169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:09.026677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:09.041355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:09.042245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:09.043103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:09.048521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 272/537] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:09.049469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:09.078935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcabdf-b1d4-465e-b3b2-30ccf5a34829 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:09.118281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:09.118941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.119222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.119494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.120197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:09.120501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:09.121978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:09.135563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 266/538] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:09.147645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:09.190600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46858-ff69-48b1-bf84-1ad6a6c0ebd2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:09.198926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:09.210936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:09.282374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205edb-92d4-4894-9271-f9cb40170387 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:09.283344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:09.284245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.284742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.285228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.286119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:09.286647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:09.288280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:09.319802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 273/539] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:09.319979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=fae1e43e357649ceb0e7d0e6f0c0c0ea) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:09.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152bef4-5b46-4cb2-a86f-05386b3d2c61 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:09.326672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:09.330632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 267/540] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:09 2022] GET /identity/v3/role_assignments?user.id=fae1e43e357649ceb0e7d0e6f0c0c0ea&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:09.392021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7deaa-30d8-4db9-b8c1-32de9670eb6a None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.392355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7deaa-30d8-4db9-b8c1-32de9670eb6a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.392575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7deaa-30d8-4db9-b8c1-32de9670eb6a None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.394247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 268/541] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:09.399919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.400280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.400462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.420839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:09.422055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:09.514839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050eda2-20c3-46de-abc9-04fe1e0e739a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:09.523255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 269/542] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:12:09.556051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:09.556578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.556854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.557125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.557847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=52a425657bc44ce6b62595045bd5da1b) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:09.558147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:09.559629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c4f8-3c4b-4fc5-8988-cc44f6093f23 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:09.565675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 274/543] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:09 2022] GET /identity/v3/role_assignments?user.id=52a425657bc44ce6b62595045bd5da1b&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:09.832329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:09.866054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:09.953294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc68af-aa65-4c5f-a028-8f5a17717791 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:09.972969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ad38-3ac0-42f8-96bd-904ecfcd5a35 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.973472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ad38-3ac0-42f8-96bd-904ecfcd5a35 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.973546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71ad38-3ac0-42f8-96bd-904ecfcd5a35 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.977691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 275/544] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:09.983366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.983661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.983940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:09.994716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:09.995609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:09.996108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:09.996593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:10.011886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:10.016965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:10.017843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:10.018648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:10.025795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 270/545] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:10.026974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:10.028396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:10.029502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.081223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:10.161846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 276/546] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:12:10.198922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:10.210737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82856a64-5961-4863-be0c-1e626d941145 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:10.277210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:10.278222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:10.278754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:10.279221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:10.280066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:10.280558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:10.282107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:10.294029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 271/547] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:10.299590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.433566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b245d5-3abf-4cca-8db4-069bf6dff86a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:10.484093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:10.484727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:10.485003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:10.485274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:10.497939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:10.499405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:10.516541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:10.517425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:10.518259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:10.518259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:10.518259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:10.518259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 277/548] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:10.524215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.554555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.585244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:10.667080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1eb1-ea1c-4403-96b2-a6bd058f02d3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:10.732293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:10.733376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:10.733854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:10.734624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:10.735469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:10.735967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:10.737533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:10.770635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93404-4f10-49ce-8a88-70b37735250c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:10.773186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 272/549] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:10.779487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.802918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:10.816215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:10.816864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:10.817150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:10.817424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:10.843555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:10.854265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:10.855247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:10.856672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:10.860450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 278/550] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:10.865519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:10.954025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:10.981476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47c89b-70a9-42de-aa8c-88ed7a3a5d76 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.025605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decc7e-118d-459b-a004-c370b094280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.026134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decc7e-118d-459b-a004-c370b094280c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.026418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decc7e-118d-459b-a004-c370b094280c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.026725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decc7e-118d-459b-a004-c370b094280c None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.029710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decc7e-118d-459b-a004-c370b094280c None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:11.030029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decc7e-118d-459b-a004-c370b094280c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.031426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decc7e-118d-459b-a004-c370b094280c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.039183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5507-42bd-4cc7-8b4e-7c430af29272 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.052937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 279/551] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:11.058131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decc7e-118d-459b-a004-c370b094280c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.112483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.113125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.115126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.115616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.136310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.138835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-7574303a-f264-4c68-9c54-67389aee8e6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:11.159424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:11.160377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:11.161441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 273/552] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:11.162547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9983-facd-4603-a99f-168f11260bff None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.162547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9983-facd-4603-a99f-168f11260bff None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.162547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9983-facd-4603-a99f-168f11260bff None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.164174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 274/553] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:11.165968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9983-facd-4603-a99f-168f11260bff None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.199183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decc7e-118d-459b-a004-c370b094280c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.245095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.246149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.246657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.247172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.251037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.255764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.261495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.263735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9b8d65cc-1b56-4710-bce4-39fb804e3f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:11.286152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:11.287134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:11.287977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:11.287977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:11.287977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:11.290694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 280/554] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:11.294203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.294495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.294792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.299283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9983-facd-4603-a99f-168f11260bff None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.326047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:11.328156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:11.337409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.338020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.338353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.338721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.339648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:11.340001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.341501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.360734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 275/555] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:11.361667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.421551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 281/556] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:11.423539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.547111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f3c4-d429-4be3-b9dd-5fde22396d16 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.556521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a16c2-b685-46a0-97c5-8e44f23c562b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.572076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.594652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.596352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.599775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.600206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.612153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.640171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.640797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.641075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.641347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.642014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:11.642288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.646238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.670014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 276/557] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:11.675531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.712416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.714907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.786083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adaea1-207c-48f6-9220-66b1057c531e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.815929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 282/558] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:11.816692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.818467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.819124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.819403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.819674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.827219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:11.828659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:11.838960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-3c7136f3-d1dd-48c3-971b-d28793f52e15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:11.839588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:11.841181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:11.842087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 277/559] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:11.842747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f6f1-37d5-4653-a2ca-76764122a82c None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.842747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f6f1-37d5-4653-a2ca-76764122a82c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.843475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f6f1-37d5-4653-a2ca-76764122a82c None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.844142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 278/560] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:11.847672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d63b1-533e-4529-a7c7-cbb990baa2d5 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.848112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d63b1-533e-4529-a7c7-cbb990baa2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.848242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d63b1-533e-4529-a7c7-cbb990baa2d5 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.849464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 279/561] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:11.850142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d63b1-533e-4529-a7c7-cbb990baa2d5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.897619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:11.919122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fcb77-4336-48cd-8df5-42dfcaf73876 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.951725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d63b1-533e-4529-a7c7-cbb990baa2d5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:11.951879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.952422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.952698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.952968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:11.963448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:11.968037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:11.968953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 283/562] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:11.969933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:11.990213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:11.990871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:11.991150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:11.991421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.001238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.002694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1a594d4c-8252-44a2-845b-fadd75a69a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:12.017031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.018019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:12.019242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:12.019242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.019242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:12.019242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 280/563] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.019242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1073-30cd-49ac-bfe5-18906846a657 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.019528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1073-30cd-49ac-bfe5-18906846a657 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.019758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c1073-30cd-49ac-bfe5-18906846a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.036717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-ab9c1073-30cd-49ac-bfe5-18906846a657 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:12.037883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ab9c1073-30cd-49ac-bfe5-18906846a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:12.050390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.070283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa8cb4-d3c9-48cf-9616-8b2027436967 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.102409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 281/564] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:12.103643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.103924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.104194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.109958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.110556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.110857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.111126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.111840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:12.112140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.113546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.124287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:12.125463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:12.143782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 284/565] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:12.143782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.154292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.218596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 282/566] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:12.218596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.279884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c2fa-b541-4f5f-a4ec-879571eab051 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.317493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.318203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.318542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.318918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.319635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:12.319996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.321512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.327548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.331845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 285/567] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:12.332836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.341994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc13156-ceac-41c7-b255-128235187ba5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.385046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.385661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.385943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.386333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.387014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:12.387318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.388689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.400289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 283/568] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:12.401085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.419964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.457719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142182-9c3c-40a1-8ee3-0d6318bbe378 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.494422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.495303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.495634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.495908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.506726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad314-1554-45d3-b168-b44dd8756e4f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.507438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.508906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:12.522789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.527199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:12.528353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:12.528353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.528353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:12.528353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 286/569] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.528353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.544191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.544821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.545101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.545658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.557176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.558669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:12.573626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.574615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:12.575519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:12.575519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:12.575519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:12.576244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 284/570] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.577066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.593622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.641337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf64bd3-075e-4297-9c0a-ba21d9618185 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.654854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.675604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.676231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.676511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.676783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.687939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:12.689067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f596-0390-4f90-a3bc-1c55564b6a5c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:12.693108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.694047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 287/571] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.695332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.722475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.723141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.723425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.723697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.730804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.732262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:12.743810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.744863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 285/572] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.750781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.794116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce96e-40dc-4953-87f3-5d53d024b45a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.806724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.827443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.828004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.828280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.828552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.839069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:12.842744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41881946-220a-44b7-9a65-842b3933bff2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:12.844158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:12.845183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 288/573] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:12.845998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.870250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:12.878493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.879289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.879583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.879864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.880508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:12.880820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.882236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.893608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 286/574] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:12.894387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:12.947505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d68c0-cc4b-4155-a9b1-a5a6a0da7f51 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.981265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:12.981904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:12.982204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:12.982475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:12.983123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:12.983419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:12.984766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:12.992510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d756365-fcc4-4be7-baa9-59bace55534b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:12.996092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 289/575] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:12.996875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.026409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.027038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.027319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.027590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.028126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.028302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.028837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.030128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.037884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 287/576] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.038687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.087119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.097709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326942d-cb2b-430c-a552-55f6e88f1231 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.129974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.130599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.130881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.131153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.131885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.132146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.134091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.136694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c65f-8e18-4396-8dc6-01fd8301b8fa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.145202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 290/577] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.146013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.176110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.176727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.177004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.177276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.177941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.178239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.179645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.188611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 288/578] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.189444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.242687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.252486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ab9f-1c65-47b6-af41-b1677ef14877 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.286262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.286977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.287261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.287536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.294076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.295538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.296513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cd01d-1ffe-4ab0-8fe2-b116ebd2018c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:13.306906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:13.307804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:13.308668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 291/579] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:13.309186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.310054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.334691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.335566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.335848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.336733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.344160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.345536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:13.356253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:13.357226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 289/580] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:13.358176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.409497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483893f-12f8-49e6-93b9-f27323545642 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.443001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.443630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.443910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.444188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.455009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.456444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.459045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29b11-f54d-4756-838b-49d5d55c722a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:13.470387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:13.471537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:13.472431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:13.472431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:13.472431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:13.472431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 292/581] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:13.472652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.476563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.497087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.497689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.497975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.498250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.498997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=dc4349bca8444e65a321cf2bf2572ded) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.499323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.500764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.506363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 290/582] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/role_assignments?user.id=dc4349bca8444e65a321cf2bf2572ded&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.507845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.546632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.579078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9fbd-01d7-45fd-9c14-12ac48f1f91a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.620646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.621232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.621632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.621902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.636103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.637599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.641449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49fa7-d632-4a92-9eaa-ec3d072f396e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:13.654036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:13.655225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:13.656285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:13.656285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:13.656285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:13.658758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 293/583] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:13.659560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.680507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.681114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.681391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.681658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.682495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.682842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.684264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.702286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 291/584] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.703055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.717392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.760952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e724-3f71-4801-9f3a-4c56912c4501 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.795773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.796378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.796657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.796931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.797655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.798076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.799626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.801778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.809167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52d8e-50f6-4bbe-b950-a153ed7bfb2a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.823823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 294/585] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.823823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.849584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.850308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.850703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.851046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.852193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.852493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.853857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.865877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 292/586] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.866473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:13.933207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922763f0-b73a-4648-a628-3596bc1c8b46 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.948151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:13.970080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:13.970713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:13.970993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:13.971265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:13.971900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:13.972201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:13.973550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:13.973989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea9380-de00-49bc-98fb-8a33dc412da4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:13.985716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 295/587] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:13.986515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.015809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.016738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.017187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.017638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/832456078b8a456fbc40368454bf106a` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.032703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=c3d216824c7946abb79dd7c65cfd1ac3, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.034135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.058655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 293/588] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:13 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:14.058655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.058655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.113182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0de7f-4cdf-4241-8db1-d60b4b813014 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.160815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.162122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.162414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.162870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.169009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17986f-e759-497a-a9b1-f5dfe5af8645 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.178023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.183607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:14.202554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:14.203599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:14.204499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:14.204499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:14.204499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:14.206729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 296/589] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:14.207708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.228823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.229467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.230161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.230356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.240979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.242528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.253317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:14.256547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:14.257467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:14.258419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 294/590] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:14.259042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.335156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f481b1-fdf8-4513-bfae-9e7f5463721d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.353316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.374642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.375585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.376009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.376446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.384364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.386133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.395358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c06392-11f0-432a-80a1-cd669df6e324 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:14.400166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:14.401299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:14.402404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:14.404640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 297/591] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:14.405658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.438020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.438716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.439001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.439277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.440167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:14.440479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.442519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.462310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 295/592] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:14.462310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.507043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.526597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0b6f5-5c4d-4c30-9421-7404fa7e75ea None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.563240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.563847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.564127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.564470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.565125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:14.565432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.566944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.585181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 298/593] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:14.586787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b475-cbd2-4bac-91a7-e00ee1a2df22 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.591059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.618941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.626511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.627447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.627817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.628157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.628957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:14.629331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.631388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.658028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 296/594] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:14.659029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.718268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f124538-7344-4fc7-937e-90d884f95fdd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.759921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.761166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.761853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.762275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.770457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.772736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.781316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110061c6-d1b0-497f-a946-ac4a959547e3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:14.787273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:14.788324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:14.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:14.791860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 299/595] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:14.792799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.818913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.825937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.826583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.826870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.827144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.838510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.840033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:14.856394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:14.857371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:14.858254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:14.858254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:14.858254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:14.858254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 297/596] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:14.862988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:14.901605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:14.926724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426073-cd55-4dac-9e0b-0a9c92f1ac04 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.973233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:14.973790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:14.974073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:14.974347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:14.977519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a358a-f272-4307-8f1b-4988d787c91a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:14.986978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:14.988945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:15.010874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:15.011943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:15.012823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:15.012823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:15.012823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:15.012823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 300/597] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:15.013567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.018290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.019185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.019686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.020155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.021040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:15.021544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.023324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.040058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 298/598] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:15.041271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.088634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.150652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cf64-2108-457a-9870-99552fb14a9e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.168321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.176171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d5ed-4cba-4127-8fbd-22b179f9ba36 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.203874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.204835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.205412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.206401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.207590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:15.208122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.210782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.221489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.222178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.222999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.223417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.224360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:15.224745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.226180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.227060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 301/599] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:15.228285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.240857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 299/600] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:15.242714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.350354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd88d-8a52-48a2-9c3d-2769efa88da7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.368094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.374293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb82f8-3aa7-4328-94f5-6b401ab893c5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.388468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.389423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.389897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.390453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/18fe513fdeb442c6bbd2e2144169ba78/roles/832456078b8a456fbc40368454bf106a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.405939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=18fe513fdeb442c6bbd2e2144169ba78, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.407654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.418938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.419577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.419942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.420228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.422978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 302/601] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:15 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/18fe513fdeb442c6bbd2e2144169ba78/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:15.424134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.435806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.437291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:15.457701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:15.458662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:15.459559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 300/602] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:15.465282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.493933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.548185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686b80b-7edb-4b52-905c-d7c00d38125a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.586983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c559-842f-40f9-92ab-2892106379e9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.590235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.591214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.591692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.592157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.600299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.602880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-25e69561-1c72-4761-92d9-cf296886c1ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:15.615499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:15.616500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:15.618319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:15.620130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 303/603] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:15.621445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ff3d-8c84-4197-8bcb-81663da147e4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.621834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ff3d-8c84-4197-8bcb-81663da147e4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.622209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ff3d-8c84-4197-8bcb-81663da147e4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.625425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 304/604] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:15.626185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97ff3d-8c84-4197-8bcb-81663da147e4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.626395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.627196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.627643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.628068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.628925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:15.629234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.630696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6d1f-92a9-46eb-9b28-ed3b116b7ce6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.646740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 301/605] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:15.648010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.648127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.648400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.662910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.667551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:15.668937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:15.746914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97ff3d-8c84-4197-8bcb-81663da147e4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:15.757300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 302/606] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:15.758396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.767399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:15.797432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:15.798320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:15.798782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:15.799204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:15.800049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:15.800518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:15.802671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:15.819257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 305/607] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:15.831107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:15.920171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14699c3-e05d-4d1b-924e-865f47650a0c None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.001449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.002039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.002327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.002627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/52a425657bc44ce6b62595045bd5da1b/roles/832456078b8a456fbc40368454bf106a` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.008573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:16.021000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a610-5da3-4034-95a7-d60a8d8cfc08 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.032978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=52a425657bc44ce6b62595045bd5da1b, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:16.034526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84e922-33da-44fb-a2b3-acf30ed1da06 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:16.060495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 303/608] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:15 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/52a425657bc44ce6b62595045bd5da1b/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:16.061259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.061773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fd468-f01a-4cd5-a518-7f7f5bc53cc2 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.062062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fd468-f01a-4cd5-a518-7f7f5bc53cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.062343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fd468-f01a-4cd5-a518-7f7f5bc53cc2 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.062907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.063404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.063948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/fae1e43e357649ceb0e7d0e6f0c0c0ea/roles/832456078b8a456fbc40368454bf106a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.064064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 304/609] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:16.069343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.069657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.069898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.085582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=fae1e43e357649ceb0e7d0e6f0c0c0ea, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:16.088130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:16.097772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:16.099816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:16.103784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 306/610] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:15 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/fae1e43e357649ceb0e7d0e6f0c0c0ea/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:12:16.105026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.178057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:16.205164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 305/611] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:12:16.275580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ff81-9df3-4551-8ece-eda62cfcc6c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.316180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.316817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.317100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.317377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.320997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:16.332976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:16.338622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:16.339733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:16.340721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 307/612] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:16.347409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.458659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b493e75-5ec8-4d4b-8489-bb5e2772c05c None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.508736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.509454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.509805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.510149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.510914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:16.511291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:16.512735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:16.524797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 306/613] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:16.530480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.570441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.660728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:16.698612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca538b-3fb8-4d0e-8416-0c2a3b35968f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.745284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4143e-a44e-4311-9b39-8807ac64e99b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.747386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.748155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.748552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.749774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.788046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:16.788708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:16.789585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:16.789936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:16.791219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:16.795969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:16.797102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:16.798102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 307/614] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:16.803991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:16.804507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.806178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:16.822074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:16.823277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:16.824342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:16.824342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:16.824342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:16.825364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 308/615] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:16.830643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:16.891378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:16.980444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79a9d-b57f-4cf2-931a-24ffec10503a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:16.998245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c0ed-5b22-4492-8931-2b6a975d23d6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.001175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.049759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.050284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.050555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.050851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.051511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:17.051809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.053168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.065880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.066490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.067418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 308/616] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:17.073094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.074007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.074278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.075030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:17.075340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.076806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.096823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 309/617] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:17.102606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.205281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae8da6-8fab-4050-9b8a-68ec0181b455 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.232227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613bc73-bc29-4722-a79c-1f8cab09914c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.252401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.279931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.280571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.280844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.281112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.303257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.305155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.308309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.308948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.309361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.309637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.323685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.326116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:17.334032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:17.335374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:17.336294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:17.336294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:17.336294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:17.340198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 309/618] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:17.345863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:17.349312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:17.350225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:17.351201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:17.351935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 310/619] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:17.361842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.396336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.485166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019b66-71de-424c-8fb8-54d869e80641 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.529137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.529746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.530021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.530290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.531318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:17.531613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.533736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.569786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 311/620] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:17.576486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500aa03-3035-4444-9c1e-2330b1a8d9b0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.578717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.635857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.647661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.648272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.653659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.653951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.654625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:17.654934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.656417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.683367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 310/621] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:17.688494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.740219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6293-ec7e-4841-84bf-352001f402b1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.775929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.776617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.776898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.777211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.779876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.790650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.792242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.799600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c019f7-a5c7-403d-a8ed-803ecd0d26a3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9f12479f-0b21-4a20-906e-e25ceb426138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:17.807831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:17.808794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:17.809699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:17.809699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:17.809699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:17.816189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 312/622] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:17.817782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2edbba-4c67-438b-8ca0-1bbd31d3f87e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.818298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2edbba-4c67-438b-8ca0-1bbd31d3f87e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.818737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2edbba-4c67-438b-8ca0-1bbd31d3f87e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.821007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 313/623] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:17.821950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2edbba-4c67-438b-8ca0-1bbd31d3f87e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.837059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.837822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.838205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.838596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.846039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.847691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-2e598dad-741c-4b55-8b2d-123b9f38d771 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:17.859443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:17.860576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:17.861703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:17.863482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 311/624] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:17.864745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.865130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.866201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.884168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:17.885563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:17.926976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:17.937956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2edbba-4c67-438b-8ca0-1bbd31d3f87e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:17.956446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 312/625] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:17.957440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:17.977222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:17.980594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:17.983293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:17.985483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:17.986587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:17.987033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:17.988740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.002604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 314/626] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:18.009322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.030292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.061500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9193-fe71-48d0-b8bc-9c1951d7d79f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.120280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.120931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.121284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.121633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.122454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:18.122858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.123413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22377e41-37ca-49c8-8363-97dc03940afc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.124461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.162350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.164372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.165029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.167150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 313/627] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:18.167673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.172486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.187921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.189698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.202907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:18.219739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:18.220729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:18.221615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:18.229208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 315/628] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:18.230246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.298762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b8e1e-cf01-4ac3-9b57-2861d185e260 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.328427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.334759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.335633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.335940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.336213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.367752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53c45-4ab3-47fb-9e0c-340107d5740f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.401580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.402288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.402660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.402944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.403633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:18.403941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.405301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.405411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff6a6d-ed55-4b1b-bbf0-f66edbbcb140 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.406781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.418860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 316/629] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:18.420101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fa94-1811-42ae-b05a-27ad5ce00168 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.420387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fa94-1811-42ae-b05a-27ad5ce00168 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.420660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fa94-1811-42ae-b05a-27ad5ce00168 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.426427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 317/630] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:18.426427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fa94-1811-42ae-b05a-27ad5ce00168 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.484155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.521395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 314/631] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 02:12:18.522221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.534685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fa94-1811-42ae-b05a-27ad5ce00168 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.552930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.572622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.573256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.573552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.573803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.584469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-52f4e4ba-fb01-4f6e-b211-1e5ce7b95895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:18.589473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:18.590441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:18.591591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 318/632] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:18.592288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.592288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.592288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.610163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:18.611425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:18.635137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a523-8031-4249-9c89-dd66ddab2340 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.671289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.671872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.672158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.672433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/dc4349bca8444e65a321cf2bf2572ded/roles/832456078b8a456fbc40368454bf106a` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.683322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 319/633] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:18.684233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.687795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=dc4349bca8444e65a321cf2bf2572ded, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.689246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.702032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 315/634] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:18 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/dc4349bca8444e65a321cf2bf2572ded/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:18.702840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.756298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.814031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6140a-0916-4870-8f0a-9f816d305c31 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.827281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:18.857843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e9ba-b15f-47ea-a481-d10ff8e6ae20 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:18.863166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.863505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.863888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.864289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.876975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.878424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-eeb5a11f-00b9-43d1-aa21-5e123bbdf780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:18.898979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:18.900167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:18.901232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:18.901232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:18.901232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:18.902671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 320/635] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:18.904022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66943-6dd8-4566-a295-ff4a3dcfa6aa None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.904396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66943-6dd8-4566-a295-ff4a3dcfa6aa None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.904812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66943-6dd8-4566-a295-ff4a3dcfa6aa None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.905600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:18.906418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.906852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.907251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.908051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:18.908498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:18.910584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7658468-84c8-4155-825a-5b78da20a934 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:18.911113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 321/636] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:18.912019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66943-6dd8-4566-a295-ff4a3dcfa6aa None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:18.927068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 316/637] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:18.929684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:18.930119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:18.931708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:18.958622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:18.960678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:19.032167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 317/638] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:19.035046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.035834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.040634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66943-6dd8-4566-a295-ff4a3dcfa6aa None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.076146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.076762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.077066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.077302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.077942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:19.078245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.079638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.096113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 322/639] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:19.096113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.132183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.168107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a8abf-3298-4c72-8356-7ce2e00ae27c None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.199468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64dc9-b516-4494-b13e-0382ba7f0d79 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.207106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.207939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.208367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.208875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.221318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.223185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.235260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.235890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.236169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.236449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:19.241418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.242382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:19.243296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:19.243296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:19.243296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:19.247841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 318/640] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.248950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.254801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:19.261123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.262085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 323/641] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.263618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.299076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.368209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e9cc-b68f-4800-aaae-efa923bb75cc None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.388805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e73ec-3666-436e-8e7c-340189738787 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.393573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.407077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.407822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.408197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.408589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.415400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.416987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.423531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.424129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.424410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.424683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.425315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:19.425614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.427061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:19.428521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.429435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 319/642] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.431732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.445307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 324/643] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:19.448225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.528826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.539124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc894e-cdab-4514-9ff8-79510f4b8d96 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.547208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbe18c-beeb-44a4-862e-cc5a2b88839e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.577747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.578462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.578829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.579179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.579916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:19.580289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.581792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.586797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.587975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.588343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.588653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.590499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 320/644] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:19.591461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.604972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:19.610461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.611398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:19.612551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 325/645] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.613666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.649989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.713534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0195-9ade-4467-8fea-82f916c29a78 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.721849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b5a35-cabc-4e89-a46a-194839b98336 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.757045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.757697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.758517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.758839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.759904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.760882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.761197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.762048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.762840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:19.763220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.764660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.766023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.767481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.770575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:19.780037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.790967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 02:12:19.792087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:19.792663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 321/646] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:19.792764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 326/647] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.792847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.792927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.891207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9696fc-6b50-42fa-b121-b25347e32d4f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.899853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3500c76-e600-49cc-81ef-09794991b7ea None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:19.908346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:19.927220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.927947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.928321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.928716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.929386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:19.930247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.931629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.939207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:19.944161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 327/648] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:19.944309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:19.944309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:19.944309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:19.944546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:19.955232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:19.957126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:19.972208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:19.973318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:19.974428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:19.974428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:19.974428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:19.979675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 322/649] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:19.980432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.011374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.052494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43aec6-9174-4140-84d6-ab483900fd4b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.087176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca996-470a-4435-8e10-7c6ca636a9a7 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.088838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.089439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.089722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.089994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.090750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:20.091057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.092473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.110365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 328/650] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:20.111243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.128490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.129191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.129472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.129745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.130467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:20.130822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.132260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.138636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 323/651] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:19 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:20.139306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.190174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.263652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e9e50-760f-4e77-93a6-e8ee2a1955ae None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.284677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37576a0-8b1c-4dbc-a7cc-f7df66faca52 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.287073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.304679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.305688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.306115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.306535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.317924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.319991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.321591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.322265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.322487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.322792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.323441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:20.323760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.325121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:20.338824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:20.339981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:20.341161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:20.341161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:20.341161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:20.342633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 324/652] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:20.346774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.346913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 329/653] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:20.348185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.447897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.469015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0852-7c09-42b3-bc7a-421fcdc65538 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.473997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d506a6-3096-45a1-8030-a3c8c5074e8b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.505170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.506083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.506510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.506965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.517027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.517295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.517721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.518115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.518467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.519389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:20.534146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:20.535374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 02:12:20.536532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:20.539776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 330/654] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:20.540958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.582881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.598946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.600658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.661262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e942d-bc5d-424e-84bd-069572c3f03b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.685592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.702305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.703343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.703894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.704177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.704824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:20.705127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.711589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 325/655] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:20.711729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d9bc-6dc4-406a-b7d5-c02f88042488 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.711807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.725158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 331/656] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:20.725158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be46bf-42c1-4fea-b9c4-e3bffac93a56 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.725158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be46bf-42c1-4fea-b9c4-e3bffac93a56 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.725158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be46bf-42c1-4fea-b9c4-e3bffac93a56 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.726150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 332/657] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:20.727046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be46bf-42c1-4fea-b9c4-e3bffac93a56 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.817966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7c18-1556-4656-80e5-22ff42c440f1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.824755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.834919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be46bf-42c1-4fea-b9c4-e3bffac93a56 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:20.861814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.862427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.862737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.863013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.863738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:20.864038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.865469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.873754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:20.874540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.874954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.875342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.887369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 326/658] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:20.887369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:20.890353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:20.891938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-64575591-33b1-4f52-987c-3f008cb7dae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:20.907330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:20.908470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:20.909576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:20.909576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:20.909576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:20.914740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 333/659] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:20.915855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:20.916140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:20.916414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:20.931893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:20.935157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:20.936350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:20.995655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a5e-d7d8-42bf-b355-c87109bddfed None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.008050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 334/660] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:21.008885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.038782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.040164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.040595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.041074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.048752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.050198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:21.062395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:21.063576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:21.064632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:21.068263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 327/661] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:21.069142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.110555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.145831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4d9a-a6a8-4634-8431-fe4c1793707b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.186647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.187444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.187977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.188407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.188809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.192192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856d9e-adcd-4d5a-9b1b-8c79babb77ee None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.230873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.231797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.232247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.232667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.233540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:21.233994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.235527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.249476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 328/662] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:21.250670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.260201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.261670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.341786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.362901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed341-429b-402a-be8e-c5308df3fdaa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.370408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 335/663] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:21.371714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.402727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.403374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.403723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.404006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.404746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:21.405107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.406594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.424764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 329/664] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:21.425573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.446152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.484673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e3d50-6a99-4139-9c42-ed3d0306a9ae None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.520515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.521357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.521638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.521913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.528992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.530366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e776-a960-41b4-8598-5fd70a991378 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.530828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:21.542612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:21.543668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:21.544751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 336/665] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:21.549685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.570323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.571072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.571361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.571638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.582441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:21.584963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:21.588014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:21.588963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:21.589788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 330/666] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:21.590504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.663248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e838a3-28e2-4111-a351-1c5ff4c07105 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.674473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.697502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be53b8-00ba-4c4f-917d-8596a8e7bda5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.699326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.699953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.700228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.700495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.712097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.713532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:21.728345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:21.729286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:21.730178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:21.730178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:21.730178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:21.730178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 337/667] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:21.730178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.739479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.740091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.740373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.740647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.809342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.810848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.821603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.838335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd6ef-01f6-4266-bb4c-5e33d3e7a12f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:21.872946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:21.873554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:21.873844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:21.874105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:21.874829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:21.875140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:21.876551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:21.893753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 338/668] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:21.893753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:21.898314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:21.922240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 331/669] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:21.923033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.001762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5abc3-0f11-4596-a173-a485b10e3b7a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.033627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5ba94-d8b4-4d33-b84e-50ee4737cc07 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.035990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.036601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.036880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.037153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.037811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.038110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.040024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.052253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 339/670] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.052253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.062381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.075362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.075971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.076247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.076528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.077169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.077472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.078867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.090703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 332/671] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.091513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.141652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.161982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713a58-09a7-40ca-bf46-d45ab07ae0bc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.201738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.202342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.202646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.202923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.203643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=18fe513fdeb442c6bbd2e2144169ba78) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.203978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.205381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.207831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331646-c400-4d06-9ec3-f92ed9794dde None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.211748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 340/672] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/role_assignments?user.id=18fe513fdeb442c6bbd2e2144169ba78&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.212339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.256615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.257268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.257556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.257865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.269691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.271229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:22.286471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:22.287670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:22.288559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:22.288559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:22.288559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:22.292766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 333/673] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:22.293782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.295608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.329153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd423-6e61-4918-b44f-1e65148ef23e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.372141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.372778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.373058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.373332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.386665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.388439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.397290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4294b294-6e4c-4d80-9dfc-f3bfdae3b3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:22.403817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:22.404747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:22.405618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:22.405618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:22.405618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:22.405618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 341/674] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:22.406300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a329-5123-4943-9ac4-d1f130b43ac0 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.406606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a329-5123-4943-9ac4-d1f130b43ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.406882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a329-5123-4943-9ac4-d1f130b43ac0 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.408120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 342/675] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:22.408851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a329-5123-4943-9ac4-d1f130b43ac0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.415101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a45809-d5b0-4526-8c04-2f4b6eaa7774 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.451571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.452125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.452690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.452968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.459855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.462109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:22.473533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:22.474429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 334/676] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:22.475534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.523895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a329-5123-4943-9ac4-d1f130b43ac0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.546925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.560019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.560613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.560897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.561175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.561821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.562124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.563525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e8eb-cfe1-4477-adc6-ee50e2555d95 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.575378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 343/677] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.576650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.576940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.577213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.589964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e87cde-eeb8-4deb-a0a2-10ee9a307939 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.595796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:22.596990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:22.626667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.627546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.628084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.628609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.629601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.630083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.631853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.649768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 335/678] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.650782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.663391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.664206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 344/679] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:22.674775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.775386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e1e8a-55fe-4732-a23c-83b3efda18a9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.801343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3147ed-2901-4c32-ba04-5a775ed11ec9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.816954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.820218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.821373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.822029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.822302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.823038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:22.823342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.825306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.839769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:22.840469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:22.840865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:22.841210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:22.841633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 336/680] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:22.842727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.849033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:22.850691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:22.863228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:22.864195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:22.865161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 345/681] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:22.865743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:22.937751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:22.974434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b84c3-ce2f-4d5a-a84b-45dfdddf0102 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:22.980951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd4de-34e3-4d80-a04b-0feabfb1d3a0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.009423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.010051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.010331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.010703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.017957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.019433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.019537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.020292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.020578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.020853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.021688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=52a425657bc44ce6b62595045bd5da1b) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.022111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.023529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.034670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 346/682] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/role_assignments?user.id=52a425657bc44ce6b62595045bd5da1b&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.034670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:23.034896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:23.035760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 337/683] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:23.036669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.088917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.163068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffacc4-8461-4852-a1df-c5acf9729f43 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.165167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177cad9-0772-4fbf-96a1-1be7bd037d6a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.198937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.206237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.207418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.208087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.208578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.214761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.215644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.215936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.216210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.217014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.217411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.218878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.221976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:23.228755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:23.229716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:23.230994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 338/684] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:23.232118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 347/685] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.234082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.237599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.342978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c25d5-1fa9-4d95-812a-731220d36b23 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.365151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.369990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4799b-27b8-4c17-882d-f5c73a4101b3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.391918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.393097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.393837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.394750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.395985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.396764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.399647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.405634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.406236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.406511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.406809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.407598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.407898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.409392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.422887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 348/686] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.423791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.428566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 339/687] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.428566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.478582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.531502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5029e-7ae1-4476-849c-14d90d9bb005 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.555826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0142c-a538-42d9-81df-3973617432d7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.567380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.568021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.568309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.568751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.579417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.580564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.594881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.595782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:23.595998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:23.597220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:23.598110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:23.598110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:23.598110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:23.598110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 340/688] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:23.598332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.599332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.599804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.600717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=fae1e43e357649ceb0e7d0e6f0c0c0ea) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.601306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.603745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.618675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 349/689] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/role_assignments?user.id=fae1e43e357649ceb0e7d0e6f0c0c0ea&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.619924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:23.671543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.714596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:23.714596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01551d8-6a9b-446c-b353-918ddbf5b263 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.762766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.763398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.763680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.763950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.818113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da203d-7288-417e-bbc2-a9a1af1e44e4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:23.872341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:23.872879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:23.873160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:23.873427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:23.874074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:23.874377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.877338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.894258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 350/690] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:23.896569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:23.898410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:23.901490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.006069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.027489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e991d-1418-4e8a-b448-8cbfe0183df4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.028203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.038198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 341/691] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:24.045330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.081606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.082250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.082531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.082835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.092617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.094208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:24.105879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:24.106914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:24.107917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 351/692] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:24.115542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.169521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe907-1b27-4b68-88b5-ea0d25aa4d41 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.213170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.214361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.215934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.216610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.233161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.235077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-bdf23234-5d32-4e8f-8316-6b616d4ea4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:24.251743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:24.252773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:24.253736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:24.253736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:24.253736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:24.256138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 342/693] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:24.257824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8673a-3631-4c0a-b3f4-c86e57d85c83 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.258311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8673a-3631-4c0a-b3f4-c86e57d85c83 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.258804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8673a-3631-4c0a-b3f4-c86e57d85c83 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.260787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 343/694] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:24.262422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8673a-3631-4c0a-b3f4-c86e57d85c83 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.277958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be310d9-e6e3-468f-86e4-45baff2a2a15 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.316260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.317252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.317738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.318235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.319326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:24.319838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.321992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca466-7bd7-4793-af86-312d9a27261b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.329920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.343218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 352/695] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:24.344764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.345254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.345910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.352725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.368040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:24.370517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:24.391690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8673a-3631-4c0a-b3f4-c86e57d85c83 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.429558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.430508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.431189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.431799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.432647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:24.433213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.434984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.449115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 344/696] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:24.450266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.454646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 353/697] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:24.455775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.575311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e89a-992e-4fff-aefe-0a5ff63aeb35 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.607114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.620904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.622056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.623087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.623765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.633741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002386-5874-4ee5-b1ca-f3e1d9831034 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.687418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.701602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.702553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.703078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.703552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.719330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.723437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:24.748822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:24.749745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:24.750668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:24.753213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 354/698] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:24.758986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.772702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.774540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.916511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a6ba-bb68-4004-a3c2-3216fab58b62 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:24.924916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 345/699] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:24.926107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:24.942093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:24.954980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:24.955518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:24.955795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:24.956065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:24.956938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:24.957048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:24.958450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:24.971206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 355/700] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:24.972026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.041356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a5b6-0551-4f96-9a23-5a928866c8e2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.046666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.081174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.082095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.082689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.082967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.094275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.095856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.108171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483f42-4315-4e69-96b9-c9385f405fd7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:25.112439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:25.113370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:25.114336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:25.114336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:25.114336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:25.114336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 346/701] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:25.115068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.151475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.152118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.152403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.152676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.164829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.166309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-150eb478-ca3f-48b2-bba8-aa64a89b2292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:25.183803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:25.184759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:25.185755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:25.185755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:25.185755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:25.185755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 356/702] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:25.185755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c982d-b368-4f77-8a55-d00d6f559bef None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.186066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c982d-b368-4f77-8a55-d00d6f559bef None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.186857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c982d-b368-4f77-8a55-d00d6f559bef None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.187795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 357/703] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:25.192571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c982d-b368-4f77-8a55-d00d6f559bef None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.194820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.236012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a40a-2340-4e42-bd06-7e2bd0321758 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.270367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.271004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.271286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.271560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.272688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=dc4349bca8444e65a321cf2bf2572ded) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:25.273000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.274841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.290768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 347/704] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/role_assignments?user.id=dc4349bca8444e65a321cf2bf2572ded&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:25.291777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.298409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c982d-b368-4f77-8a55-d00d6f559bef None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.301336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.356812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.357847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.358329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.359184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.360009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:25.360497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.362702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dbc25-ae8f-4f9c-bfd0-44e32cb91a47 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.385925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 358/705] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:25.387935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.388908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.389336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.436935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412aa89-d82c-42fc-938b-c6185950de76 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.477218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.480333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.481661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.482433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.482762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.484071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:25.484524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.485941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.500758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 348/706] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:25.501630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.537292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:25.537797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:25.616492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 359/707] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:25.617708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.623084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb9dd-ae31-4b57-aa1a-29d454a3c874 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.662995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.663611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.664441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.664726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.665369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.666953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.691062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 349/708] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:12:25 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:25.731538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.739774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c18bc-599e-4576-b22a-896d2b15c654 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.782502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:25.783188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:25.783468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:25.783741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:25.798439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:25.799948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:25.819316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:25.822009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:25.824209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 360/709] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:25.828408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:25.903821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:25.967727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c69c5-480c-4057-8911-9a10b314bca0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:25.995213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:26.009175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:26.009802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.010084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.010355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.011085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:26.011404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:26.012820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:26.026761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 350/710] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:26.032962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:26.113282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1e45-22ce-4258-a7ca-e94df95af198 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:26.157014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84415-9cc3-4797-8219-62c6db70e4d7 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:26.160357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:26.164455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:26.165364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.165887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.166386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] PATH_INFO: `/v3/services/network` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.167212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:26.168791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7ae9f764-9e35-498a-9be7-4cea7659054c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:26.192148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:26.193281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:26.194162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:26.198511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 361/711] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:25 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:26.200868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cee9f-9c8c-430d-b7cd-4ab555cc87ad None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.201352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cee9f-9c8c-430d-b7cd-4ab555cc87ad None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.204774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cee9f-9c8c-430d-b7cd-4ab555cc87ad None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.213728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 362/712] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:26.215480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cee9f-9c8c-430d-b7cd-4ab555cc87ad None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:26.242676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:26.252644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:26.253511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.253944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.254346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.255288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:26.255741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:26.257361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018b65-b30f-4184-922d-2af0dc2271c1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:26.276750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 351/713] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:26 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:26.278369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.278881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.279289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.313224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:26.316194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:26.407936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cee9f-9c8c-430d-b7cd-4ab555cc87ad None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:26.465699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:26.468504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.469124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.469598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.470468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] RBAC: Adding query filter params (name=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:26.471939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:26.474448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:26.481086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 363/714] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:26.495862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:26.520221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 352/715] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:26.646932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:26.687545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca0ab9-9279-4050-a828-9bd0abe63947 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:26.745836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:26.747450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:26.747931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:26.748428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:26.749261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] RBAC: Adding query filter params (type=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:26.749769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:26.751354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:26.763955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 364/716] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:26.933556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:27.038850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:27.044005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1052-4f2d-4f77-b1af-0dffca51689e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:27.080273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:27.080918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:27.081200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:27.081473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:27.082059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:27.083461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:27.094756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:27.095824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:27.096705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:27.100671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 353/717] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 19 02:12:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:27.102152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:27.229804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf480b5-b4db-4973-adb5-21db7ef4ecea None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:27.277063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:27.277698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:27.277975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:27.278248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:27.278930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:27.279232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:27.280644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a010-2627-4dda-a439-f3676c758f22 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:27.286526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 365/718] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:27.292771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:27.422251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d44342-ca41-4cc6-a0fa-ee562cc2acfa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:27.456635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:27.457280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:27.457563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:27.457890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:27.458595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:27.458917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:27.460576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f0b18-6614-4dbd-aa7b-74ca8628ee6e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:27.470711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 354/719] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:27.550074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21aa89-a619-4195-b407-35ca7ced897a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:27.550262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21aa89-a619-4195-b407-35ca7ced897a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:27.550543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21aa89-a619-4195-b407-35ca7ced897a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:27.552227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 366/720] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:27.558527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65091d-206a-42fe-a851-0295c734181e None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:27.558842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65091d-206a-42fe-a851-0295c734181e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:27.559105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65091d-206a-42fe-a851-0295c734181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:27.578440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3b65091d-206a-42fe-a851-0295c734181e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:27.583882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3b65091d-206a-42fe-a851-0295c734181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:27.612114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:27.670721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 355/721] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:27.964128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21aa89-a619-4195-b407-35ca7ced897a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:27.982199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:28.092182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21aa89-a619-4195-b407-35ca7ced897a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:28.135202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:28.135835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.136113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.136386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.146738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-43b92709-df73-4d7e-93fd-b29c3b26068a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:28.159495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:28.160462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:28.161288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 367/722] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:28.167263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65091d-206a-42fe-a851-0295c734181e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:28.324758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65091d-206a-42fe-a851-0295c734181e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:28.355920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cb79-8808-4a4e-af54-1a10c96141d9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.356266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cb79-8808-4a4e-af54-1a10c96141d9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.356479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cb79-8808-4a4e-af54-1a10c96141d9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.361581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 368/723] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:28.363102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819033-7bba-4489-a949-35a339177d00 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.363483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819033-7bba-4489-a949-35a339177d00 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.363807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819033-7bba-4489-a949-35a339177d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.368311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:28.369159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.369616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.370074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.370963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:28.371455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:28.373039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:28.386611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-22819033-7bba-4489-a949-35a339177d00 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:28.386611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-22819033-7bba-4489-a949-35a339177d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:28.387129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 356/724] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:28.389259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:28.430922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:28.514938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:28.518003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 369/725] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:28.557149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d04b-02de-4a54-96bc-a7f7e00a77d3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:28.598073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:28.598645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.598930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.599204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.611024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:28.612474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-0e1606b6-4cb7-482d-a594-1a56e397efbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:28.627030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:28.627985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:28.628878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:28.628878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:28.628878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:28.632906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 357/726] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:28.634270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819033-7bba-4489-a949-35a339177d00 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:28.703322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce6af-2f37-4f6a-b261-35df03e5fec7 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.703663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce6af-2f37-4f6a-b261-35df03e5fec7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.703872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce6af-2f37-4f6a-b261-35df03e5fec7 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.705212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 358/727] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:28.712021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.712546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.713027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.735774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:28.736977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:28.793601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819033-7bba-4489-a949-35a339177d00 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:28.853131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:28.862962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 359/728] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 02:12:28.864429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:28.865330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:28.865827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:28.866319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:28.867349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:28.867863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:28.869556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:28.883464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 370/729] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:28.891664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:28.932397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.033282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.069599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d8667-c733-489a-98f7-6406550bb982 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.103626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72878-e904-49d4-a9de-c8b7592cd2d6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.134075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.134737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.135015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.135286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.152763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.154243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:29.168412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:29.169824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:29.170808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:29.175107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 360/730] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:29.177575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.178266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.178548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.178870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.183183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.194980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:29.201404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:29.202503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 371/731] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:29.208128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.254639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.299390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1aef9-7c53-4a44-b00f-2c6cc5833a6f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.332707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b5b6-4787-4422-9ba2-bc43705b50a0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.341835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.342645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.343224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.343349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.344170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:29.344544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.346044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.353810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.368449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 361/732] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:29.369454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.369933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.370219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.370591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.370967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.385463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:29.392701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:29.393673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:29.394704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 372/733] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:29.395597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.504025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84038a2-7782-4d81-9eea-28238392b3b7 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.512481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a17b2-cc75-46a5-a383-ed88f4c57d03 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.528163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.548582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.549204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.549484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.549764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.550873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.551636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.552452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.552629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.554103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:29.554474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.556024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.570977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 362/734] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:29.570977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.600645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.621248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.622632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.675310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adda5-d687-49da-8c0e-f3422a4a275c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.708465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.709080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.709344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.709614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.710515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:29.711758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.713480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d87e8-cecd-4b0b-9747-751a3bb3c3b1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.721807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 363/735] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:29.727344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940de6-862b-4498-936e-34fbaa0468f9 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.727630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940de6-862b-4498-936e-34fbaa0468f9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.727900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940de6-862b-4498-936e-34fbaa0468f9 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.733431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 373/736] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 02:12:29.733431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.733665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 364/737] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:29.734007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940de6-862b-4498-936e-34fbaa0468f9 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.778898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.814101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:29.833888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706479f-4982-49d5-b5b0-857feda2135f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.834727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940de6-862b-4498-936e-34fbaa0468f9 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:29.866901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.867520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.867797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.868071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.868647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:29.869267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.869549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.869833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.877909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.879298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.879743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:29.881175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4a5bc653-a563-4078-b70f-ce21f2a4d776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:29.893898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:29.895010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:29.895914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:29.895914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:29.895914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:29.895914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 374/738] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:29.896165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:29.896996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:29.897868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:29.897868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:29.897868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:29.898033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94441b-234b-41fa-9abc-78084fa522c5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.898033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94441b-234b-41fa-9abc-78084fa522c5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.898033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94441b-234b-41fa-9abc-78084fa522c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.898249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 365/739] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:29.898249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.916276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2e94441b-234b-41fa-9abc-78084fa522c5 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:29.917455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2e94441b-234b-41fa-9abc-78084fa522c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:29.982430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 375/740] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:29.983702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081979-620c-4f46-8c8d-cced08d98ec4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:29.984087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081979-620c-4f46-8c8d-cced08d98ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:29.984251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081979-620c-4f46-8c8d-cced08d98ec4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:29.986717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 376/741] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:29.987468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081979-620c-4f46-8c8d-cced08d98ec4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:29.995428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.006544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54c8a6-75ea-49b3-857b-17b1e340fd51 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.041669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.042300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.042598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.042946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.053784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.055818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:30.069504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:30.071152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:30.072064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:30.072064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:30.072064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:30.072064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 366/742] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:30.072064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.077802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.119277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081979-620c-4f46-8c8d-cced08d98ec4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.156005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.156613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.156895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.157171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.157810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:30.158112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.159491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d92a6-8be9-4fe1-86a6-d09dc55d8541 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.170520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 377/743] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:30.171706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.171988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.172263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.191712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:30.192306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015c33-b161-4fcb-92c8-410d6bd152ed None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.192896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:30.229823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.230429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.230776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.231052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.231696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:30.232000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.233487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.251213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 367/744] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:30.251213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.260228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.265147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 378/745] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 02:12:30.265986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.319869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.363139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d32ca-fc1f-4a0a-81e6-ab14035f16be None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.373405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84812b-aaad-4023-b84c-43eaa67e0205 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.399816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.401204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.401961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.402456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.403483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:30.404278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.406176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.408413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.409038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.409324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.409580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.417226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.418689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.422448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 368/746] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:30.423464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:30.431044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:30.431979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 379/747] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:30.432921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.495650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.531838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025c785-5322-4d23-aced-d6d9f03d709b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.541255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681234-9eba-4dfe-92d4-0f53f50a76ed None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.555156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.566363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.567014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.567293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.567561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.574318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.575771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.577013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.577614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.577896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.578180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.578843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.580182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:30.587204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:30.588363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 369/748] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:30.589857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.602610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 380/749] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:30 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:30.602610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.718187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abd242-477b-4ba5-a033-3a9134757e13 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.729563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b05ca-ad64-4014-b773-0b62bfeeb446 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.749158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.761979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.762768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.763144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.763513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.770462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.770653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.771192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.771481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.771759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.772445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.772567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:30.772834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.774774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:30.784163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:30.785151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 370/750] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:30.786140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.796048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 381/751] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:30.797122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.824901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:30.893257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4413b3-ab10-43d6-b696-d6bd7032b8cf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.905729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a976-fb17-4415-9c73-0aa0ba240a00 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:30.929074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.929716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.929998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.930277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.930961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.932331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.942766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:30.943369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:30.943651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:30.943920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:30.944641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:30.944935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:30.946356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:30.950624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 371/752] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:30 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:30.950624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:30.973757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 382/753] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:30.974917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.029592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.077176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.100877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aa557-453d-452f-98b6-4f253db1646b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.117568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3ae1-f999-4c43-9b63-3e84c685c830 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.139057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.139662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.139939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.140207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.157184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.157885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.157994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.158266 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.159028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:31.159446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.160913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.179605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 372/754] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:31.180863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.232697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.234208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.312199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d787a-2fda-420c-8c40-66ee41497dd5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.314428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.326556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.345542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 383/755] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:12:31.346738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.361411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.362213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.362499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.362820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.378761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.380572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:31.400322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:31.401277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:31.402178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:31.402178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:31.402178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:31.407573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 373/756] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:31.408648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.477346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adf64b-87bd-4f7a-93a9-8921ee8eb78a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.514816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.515461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.515754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.516014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.516741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=dc4349bca8444e65a321cf2bf2572ded) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:31.517030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.518970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.534602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 384/757] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/role_assignments?user.id=dc4349bca8444e65a321cf2bf2572ded&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:31.534602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.537227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222106d9-22ab-4680-bbb3-43bc58abbb09 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.612048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.612980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.613253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.620514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.724883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6494b5-e6de-429d-b936-9e92e7b3405f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.767747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.768762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.769257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.769755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.770650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:31.771157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.772869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.788019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 385/758] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:31.796973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.827616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.830195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:31.858344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:31.859373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:31.860272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:31.860272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:31.860272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:31.862346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 374/759] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:31.871430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:31.881411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.924035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7894d-24cc-4bfd-8f76-5540fac1a2f6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:31.935248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:31.977594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:31.978284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:31.978580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:31.978850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:31.992014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:31.993479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:32.016425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:32.017367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:32.018894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:32.024758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 386/760] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:32.025977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:32.035559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068cc3f-cb20-43c7-b290-574d97921cf2 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.075186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.075915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.076195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.076463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.077147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:32.077453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.078849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.106148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 375/761] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:32.111809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:32.231535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:32.244530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701cd75-bb1d-4018-bd7f-640e84ef558c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.269910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c91d92-b49a-4d0a-9d21-2e82efc0349d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.308464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.309433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.311194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.312377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.325743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.327212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.332238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.333097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.333603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.334083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.335010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:32.335789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.337385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:32.342438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:32.346918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:32.347834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 376/762] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:32.351372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:32.376771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 387/763] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:32.382522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:32.459708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:32.463508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7e3b-0d8c-49b9-a4f6-e5278d62f992 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.489919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:32.500417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.501023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.501399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.501679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.502368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:32.502697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.504288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.518295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 377/764] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:32.524144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:32.600462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220a4b-3abc-4307-b454-f751536a4b87 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.631250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528bf44-3a3d-40ea-aac9-4b6532257f6a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:32.667632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.668237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.668513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.668784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.669504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c93e1c97e34048c3a49742d523b7eaf2) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:32.669826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.674590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816428e-9a92-4866-9036-64953f6591fb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.677478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 378/765] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:32 2022] GET /identity/v3/role_assignments?user.id=c93e1c97e34048c3a49742d523b7eaf2&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:32.682539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c344ee-bd27-4ec0-bea0-ef9380596875 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.683421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c344ee-bd27-4ec0-bea0-ef9380596875 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.683699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c344ee-bd27-4ec0-bea0-ef9380596875 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.686957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:32.687646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.687924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.688202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.693162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 379/766] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:32.694697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55eec1-2bd4-446e-9058-b47daffa7b0d None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:32.695031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55eec1-2bd4-446e-9058-b47daffa7b0d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:32.695310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55eec1-2bd4-446e-9058-b47daffa7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:32.699523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=c3d216824c7946abb79dd7c65cfd1ac3, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:32.700995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:32.723817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 388/767] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:32 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:12:32.729620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4a55eec1-2bd4-446e-9058-b47daffa7b0d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:32.730919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4a55eec1-2bd4-446e-9058-b47daffa7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:32.821871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:32.853544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 380/768] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:33.142081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.181142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921972-a4cd-41de-9640-bca61c77c7fd None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.181484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921972-a4cd-41de-9640-bca61c77c7fd None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.181685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921972-a4cd-41de-9640-bca61c77c7fd None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.183371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 381/769] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:33.195922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.196205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.196467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.224635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:33.225917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:33.235397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:33.249431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb36fe-084d-43d0-9be1-26aefcd926c6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:33.313931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:33.314587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.314861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.315129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] PATH_INFO: `/v3/services/network` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.315714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:33.317068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:33.331822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:33.332850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:33.333686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:33.340295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 389/770] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:33.343568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.367459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 382/771] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:33.456657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae99dd-d1fa-4b96-99e0-4753afa308ed None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:33.491341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:33.492507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.492785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.493053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.493676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] RBAC: Adding query filter params (name=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:33.493972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:33.495342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:33.500185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 390/772] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:33.505679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.605067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aedfa-1e44-444e-a6df-0d94e20c3926 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:33.615658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:33.639383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:33.639984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.640261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.640529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.641153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:33.641509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:33.642897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:33.650990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 383/773] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:33.656786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.676409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:33.740462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.777895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fe8b-c334-40ef-a9e6-182ebf260004 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:33.821706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:33.822326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:33.822633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:33.822918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:33.823630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] RBAC: Adding query filter params (interface=public, service_id=a642d0dee9884e4caff70940ec968d88, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:33.823942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:33.825308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:33.846211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 391/774] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/endpoints?service_id=a642d0dee9884e4caff70940ec968d88&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:33.853839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:33.939165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea096-31bf-4b3c-a983-a4ae62042ba6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.009773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.010392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.010704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.010981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.011569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:34.012940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:34.030915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:34.032628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:34.033630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:34.034467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:34.038642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 384/775] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:34.043354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.067316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0318309-ec10-4d94-8182-59c03a22ed84 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.108879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:34.116564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.117313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.117630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.118002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.118635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:34.120004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f812bc7-4398-4e8a-a3f7-281633414b82 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:34.125910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 392/776] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:33 2022] GET /identity/v3/services => generated 772 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:34.127101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904b4-844e-4107-a358-6dd3fa184313 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.127384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904b4-844e-4107-a358-6dd3fa184313 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.127663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904b4-844e-4107-a358-6dd3fa184313 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.133966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 393/777] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:34.135443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.135848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.136132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.161345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:34.162613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:34.247982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 394/778] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:34.261071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee9ef-7d4a-47d6-984f-f7a5fde16c09 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.319536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.320690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.320975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.321250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.321887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:34.322190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:34.323584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:34.335153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 385/779] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:34.342117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.473857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:34.519142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63445-596d-4bda-8999-f7c73d1d0c24 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.566972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.582320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.583380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.584647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.585138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.586616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:34.587167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:34.590428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:34.601730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 395/780] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:34.612123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.771548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953e97-4b97-4f9f-89cf-6875e45ef7b5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.773171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f1e70-2148-4a76-947f-6e7ab5796275 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:34.778886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:34.832527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.833143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.833428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.833704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.834413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] RBAC: Adding query filter params (interface=public, service_id=0fbfdbbc5a534167b1b24799bd87f9e4, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:34.834749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:34.840375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:34.847219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 396/781] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/endpoints?service_id=0fbfdbbc5a534167b1b24799bd87f9e4&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:34.853395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.856323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:34.859960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:34.860616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:34.860961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:34.861239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:34.884024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:34.901355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:34.902336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:34.903852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 386/782] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:34.908282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:34.984013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab945-8b84-44f8-b135-5c8966109209 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.030098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.031170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.031898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.032819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.033955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.035277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe55f6-3353-4276-8e0b-95a95c6ca93e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.035866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c80c9-402c-4f2d-ac28-a8ad54d0bfdc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.048954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 397/783] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:35.051217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e0d-8f56-4456-82f2-eb25bc517911 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.051752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e0d-8f56-4456-82f2-eb25bc517911 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.052229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2e0d-8f56-4456-82f2-eb25bc517911 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.054177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 398/784] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:35.064885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.065554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.066048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.089324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:35.091738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:35.113344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.113976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.114305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.114603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.115302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:35.115608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.117713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3b1d-62f4-49e5-a586-aa1d699913c5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.127448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 387/785] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:35.128749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37f94-f0e4-480e-8108-7c881c9f4525 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.129054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37f94-f0e4-480e-8108-7c881c9f4525 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.129313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37f94-f0e4-480e-8108-7c881c9f4525 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.130866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 388/786] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:35.135806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.136089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.136363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.157668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:35.158792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:35.172288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.178589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.198775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 399/787] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:35.199896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.240747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 389/788] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:35.307537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfbfcb-6391-4f80-a3c6-7d902634b00a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.343134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.343752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.344033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.344307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.356698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.358149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:35.373811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:35.374836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:35.375756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:35.375756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:35.375756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:35.375756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 400/789] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:35.380724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.520839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb21a-59f8-4a6e-93e9-90fec973d391 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.540952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.558502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.559464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.559947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.560441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.561292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:35.561796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.563404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.576654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 390/790] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:35.583845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.617482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.619742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.672993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36e451-a944-40a6-949a-08cd50f01b91 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.707813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.708446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.708728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.709002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.717205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca2185-19a7-4957-bd57-a857484b5842 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.720468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:35.725712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:35.726694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 401/791] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:35.732420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.764692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.765862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.766473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.766972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.775815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.777753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:35.790037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:35.791038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:35.791985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:35.794832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 391/792] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:35.795893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.852719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f0ea5-e154-48ac-9fc6-a1ea4edd28b0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.865275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.886678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:35.897424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.899066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.899575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.900060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.911710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:35.913991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023cf3-22ef-420c-a309-149107467ec4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:35.917820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:35.918789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:35.919635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:35.927022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 402/793] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:35.928343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:35.950029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:35.950844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:35.951048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:35.951274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:35.951935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:35.952296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:35.953667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:35.963172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 392/794] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:35.963984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.041353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824128-3cf8-409d-8aba-738662641b09 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.071993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c28b5-ac51-43b0-a636-6d9a1c3d0ea7 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.079354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.080296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.080786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.081259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.082228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.082764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.084457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.104555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 403/795] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.105781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.112391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.113354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.113641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.113921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.114676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.114989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.116587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.119756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.127023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 393/796] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.128247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.140548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.231783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029bf9b-8e86-4d6d-9566-3cd0bf323d89 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.234998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036c6b-7c42-48c1-8525-8e07abde9b8d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.268034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.268678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.269192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.269192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.274679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.275560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.276040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.276562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.280453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.281916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.289220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.291071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:36.297924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:36.298916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:36.299830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:36.299830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.299830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:36.303967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 394/797] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:36.305593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:36.312237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:36.313179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:36.314068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:36.314068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.314068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:36.315906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 404/798] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:36.317057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.363288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.407762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.418689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eec26b-b0f5-4039-8180-aee90e4eb0a8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.432149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b0b21-b40a-4335-a75e-8d92bb26da73 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.453368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.453993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.454278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.454557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.465777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.465891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.466441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.466757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.467033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.467248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.467669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.467973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.469310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-410a536d-e7c4-49e9-9bea-293c24c6eb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:36.483076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:36.483990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:36.484903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:36.484903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:36.484903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:36.485070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 405/799] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.485070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.486364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 395/800] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:36.488034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ebb5-6bf8-4353-9568-eddceb2e5501 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.488655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ebb5-6bf8-4353-9568-eddceb2e5501 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.488922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ebb5-6bf8-4353-9568-eddceb2e5501 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.492889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 396/801] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:36.492889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ebb5-6bf8-4353-9568-eddceb2e5501 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.593071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe119-d42a-45e0-81e8-e711892c7870 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.599496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ebb5-6bf8-4353-9568-eddceb2e5501 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.601008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.628774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.629433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.629708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.630006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.630665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.630967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.632315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.637679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.638537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.639031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.639318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.639432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.645087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 406/802] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.646087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.650934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.652424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-d0b4ae2e-e544-4af2-b529-ecfe7ef4dc70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:36.664389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:36.665463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:36.666360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 397/803] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:36.667380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.667380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.667380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.685051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:36.686257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:36.758842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 398/804] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:36.759692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.759991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18df9-8084-4409-9a58-0d0d48b280f2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.798760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.799608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.800176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.800617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.801518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.801826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.803336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.820235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 407/805] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.820235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.873003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.882398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:36.886233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698a791-6447-4a67-bd7a-b1170d4dc509 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.922056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.922717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.922999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.923275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.930612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.931914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.933782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8378-9069-4a88-91a9-bfd9853d428b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:36.943294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:36.944254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:12:36.945247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:36.949107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 399/806] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:36.949940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:36.975547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:36.977159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:36.977742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:36.978221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:36.979147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:36.979706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:36.981413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:36.995542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 408/807] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:36.996617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.081530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b7b8-9293-4f94-9bc1-438405dc6e28 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.115827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.116449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.116745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.117015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.124696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.126112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.129152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0a04e-ec6e-4017-ac98-e1fbcd16b876 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:37.137574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:37.138497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 400/808] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:37.144783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.151764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.160321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.176548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.177471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.177901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.178320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.179338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:37.179845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.181423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.200077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 409/809] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:12:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:37.200733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.256308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94559b7-a172-4d57-ad01-f81887360f09 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.289835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.290486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.290789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.291069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/dc4349bca8444e65a321cf2bf2572ded/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.292978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=dc4349bca8444e65a321cf2bf2572ded, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.294391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.296805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860903f-4347-4440-a0da-e946122bff42 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.307220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 401/810] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:37 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/dc4349bca8444e65a321cf2bf2572ded/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:37.308069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.337458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.338111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.338395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.338986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.339300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.340768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:37.350285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:37.351467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:37.355973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 410/811] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:37.356907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.391075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.409957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.430726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fd9f-080e-4976-9523-4e720105a06f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.474882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.475952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.476478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.476894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.477763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:37.478235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.478451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b59cef-a0a5-434c-b9fb-796aa8fcf0b3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.480163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b969-de6f-4dd9-b77d-d3a047498519 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.500022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 402/812] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:37.501533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694a354-336e-4ed9-b8f3-05cf72110bae None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.501983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694a354-336e-4ed9-b8f3-05cf72110bae None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.502398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694a354-336e-4ed9-b8f3-05cf72110bae None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.504098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 403/813] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:37.505100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694a354-336e-4ed9-b8f3-05cf72110bae None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.521001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.521735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.522017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.522413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.595260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.596868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80677-a48a-48b5-8273-e01ddc083741 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.612382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694a354-336e-4ed9-b8f3-05cf72110bae None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.637366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.645929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.652167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.652784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.653054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.653330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.653988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] RBAC: Adding query filter params (name=network) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:37.654285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.655682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.660078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 404/814] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:37.660839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.716997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 411/815] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:12:37.718447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.718848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.719197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.736812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:37.738087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:37.770335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c015a-52cc-464a-9b4c-83f68dac900d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.805828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 412/816] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:37.806700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.808245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.808871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.809152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.809425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.824877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.826640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:37.841320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:37.842274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:37.843188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:37.843188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:37.843188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:37.849709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 405/817] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:37.850773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.887750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.911240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:37.924155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a859d3e-262c-4222-8f14-e7d7932000f3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:37.963119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:37.964152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:37.964713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:37.965211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:37.966073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] RBAC: Adding query filter params (type=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:37.966709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:37.968252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:37.974081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 413/818] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:37.975151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:37.981172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87ba1-046c-4aeb-8573-834808a4b7c5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.024254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.024876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.025155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.025675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.038160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.040264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:38.055487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:38.056459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:38.057451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:38.057451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:38.057451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:38.061222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 406/819] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:38.062041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.087391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a026f-7f84-49c6-833a-a3fd0e8c6037 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.123666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.124274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.124555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.124830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.125466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.125769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.127158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.128624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.140058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 414/820] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.140876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.169226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.173831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8544-e83b-42a6-80d6-f14aa4c401c1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.213558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.214163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.214439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.214742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.215392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.216742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.240646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 407/821] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:38.241890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.282757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5daa06-e549-4933-97f8-2165c027edf6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.343971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.344658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.344944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.345221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.345937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.346248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.347819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.367287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 415/822] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.368258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.390197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a92b1-7c85-4ead-8c16-620687f36bb9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.439496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.440372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.440798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.441240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.441827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.443268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.443706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:38.454293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:38.455382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 02:12:38.456223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:38.461556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 408/823] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:38.462418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.483741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.498938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86330-f38a-4ada-8710-b7da0cf9c85d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.535424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.536057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.536336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.536603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.543834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.545250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:38.557430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:38.558450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:38.559364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:38.563545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 416/824] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:38.564341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.574878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993724c-6649-41b2-a68f-2e0ca307ae81 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.613044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.613652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.614052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.614323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.621100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.622533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:38.634478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:38.635420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 409/825] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:38.636341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.672657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1fc7-1bd6-4b76-8b35-0e67fd0362db None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.683525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.709024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.709559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.709828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.710096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.711545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.711844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.713200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.718082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 417/826] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.719011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.725856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.749170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8cfe-3211-4f00-98d5-0867434b53af None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.785920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.786528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.786838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.787106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.787791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.788094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.789549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.802700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 410/827] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.803350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.831252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51833f2c-2d6d-40af-8fb1-77466e91ac8a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.865821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.866889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.867269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.867650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.868434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.868748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.870164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.882097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 418/828] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.883491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.912141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcac43-215a-49a6-8661-2f8e023f8096 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:38.919215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.949490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:38.950306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:38.950759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:38.951172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:38.951948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:38.952434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:38.954044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:38.959483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 411/829] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:38.961779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:38.964445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:38.995330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2878-1639-4925-bc41-de9e17fe15e8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:39.035262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:39.036007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.036355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.036695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c93e1c97e34048c3a49742d523b7eaf2/roles/832456078b8a456fbc40368454bf106a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.050986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=c93e1c97e34048c3a49742d523b7eaf2, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:39.052496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:39.064551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8687e7-61e6-45fb-adcd-43f0f181766c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:39.067850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 419/830] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:38 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c93e1c97e34048c3a49742d523b7eaf2/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:12:39.068857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:39.112980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:39.113887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.114765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.115157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.116031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:39.116447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:39.119603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea97b0-592d-4af6-9a15-ddcc320ca2c3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:39.129405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 412/831] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:38 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:39.199278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:39.220529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de25b-df3a-46af-8309-b4cc057c21c2 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.220714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ca19-cf65-4ccd-b1c8-f5cadff2edf2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:39.220949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de25b-df3a-46af-8309-b4cc057c21c2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.221324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de25b-df3a-46af-8309-b4cc057c21c2 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.226323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 413/832] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:39.230474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.230931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.231304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.251647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:39.252861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:39.260942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:39.261561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.261838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.262108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.262804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:39.264192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:39.295440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 420/833] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:39.326713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:39.346315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 414/834] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:39.623252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:39.733213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f415-3654-49d0-a63d-3015b9b03b92 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:39.768958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:39.769589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.769868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.770138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.779100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:39.782801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:39.787465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:39.789584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:39.791520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 421/835] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:39.796922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:39.901605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7527d7-6ae6-4bce-942d-9e0366df8d28 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:39.936842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:39.937452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:39.937735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:39.938012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:39.938769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:39.939075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:39.940503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:39.949660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 415/836] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:39.955633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:40.061706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fd6a3-48fc-4ef8-a2fc-56328ca750c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:40.094997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:40.095625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:40.095954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:40.096232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:40.108650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:40.110075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:40.125216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:40.126183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:40.127304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:40.127304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:40.127304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:40.127304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 422/837] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:40.133729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:40.191786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:40.239932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b379a1-47f5-48f0-bb3b-7d2059096314 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:40.276846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:40.277796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:40.278271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:40.278786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:40.279616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:40.280128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:40.281663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:40.299328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 416/838] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:40.301300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:40.362768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:40.421044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cddd3-46db-4f0e-a875-6f1f01b6b481 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:40.455553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:40.456529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:40.457007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:40.457526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:40.467142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:40.469006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:40.482623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:40.484365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:40.485306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 423/839] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:12:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:40.492443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:40.596915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7809-9eca-4051-80d8-bdec06fa72d1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:40.611678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:40.632017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:40.632660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:40.632941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:40.633216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:40.633943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:40.634249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:40.635727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:40.653745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 417/840] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 19 02:12:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:40.659492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:40.766976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd0cc-8538-4543-84ef-2dedd8961726 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:40.781331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:40.805413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:40.806425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:40.806946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:40.807412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:40.878737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:40.880606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2604a69-6319-4388-bc93-73586a28f489 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:40.990303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 424/841] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:12:40.992097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.096364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4911-bf04-45ae-b466-d0715160342c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.115868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4493e-7300-45ae-8a7d-c1af3f33c74c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.116166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4493e-7300-45ae-8a7d-c1af3f33c74c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.116423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4493e-7300-45ae-8a7d-c1af3f33c74c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.118057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 425/842] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:41.122528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cc01a-7e81-43dc-8022-f6f2623a2a55 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.122842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cc01a-7e81-43dc-8022-f6f2623a2a55 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.123120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cc01a-7e81-43dc-8022-f6f2623a2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.138683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.140186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.140934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.141403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.145188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-635cc01a-7e81-43dc-8022-f6f2623a2a55 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:41.146362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-635cc01a-7e81-43dc-8022-f6f2623a2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:41.157346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.159591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.160942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ce641f48-3dba-4c77-bbd6-cb18dbcddcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:41.180018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:41.181001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:41.181865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:41.181865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:41.181865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:41.188747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 418/843] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:41.188747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b1ef-50d1-42ac-8814-05a73dd5e8c6 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.188747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b1ef-50d1-42ac-8814-05a73dd5e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.188747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b1ef-50d1-42ac-8814-05a73dd5e8c6 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.188747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 419/844] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:41.190529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b1ef-50d1-42ac-8814-05a73dd5e8c6 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.218736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.228744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 426/845] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:41.229983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0083c-0e38-45b3-b706-5bd45502a5ff None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.230267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0083c-0e38-45b3-b706-5bd45502a5ff None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.230539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0083c-0e38-45b3-b706-5bd45502a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.248028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e6d0083c-0e38-45b3-b706-5bd45502a5ff None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:41.249401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e6d0083c-0e38-45b3-b706-5bd45502a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:41.316323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b1ef-50d1-42ac-8814-05a73dd5e8c6 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.333789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 427/846] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:41.355716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.356254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.356572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.356848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.357528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:41.357825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.359268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.362304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcc7b-25f6-4c98-bdbe-1dc92724c8a7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.362629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcc7b-25f6-4c98-bdbe-1dc92724c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.362919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcc7b-25f6-4c98-bdbe-1dc92724c8a7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.364491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 428/847] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:41.369789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.370076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.370356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.372550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 420/848] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:41.377845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.392867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:41.394162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:41.474593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 429/849] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:41.481525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.499446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10131fb6-67e5-4560-86ea-61830252e4ef None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.539884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.540504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.540778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.541044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.547840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.549264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.557703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.560587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:41.560777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:41.561696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:41.562629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 421/850] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:41.567575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.669505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a53465-42f5-44f8-bcf3-e2f28c32afee None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.670149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817b4f-d5a4-46e7-8ea7-6582374ba420 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.703624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.703907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.704226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.704458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.704558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.704734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.704832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.705004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.705489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:41.705731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.707190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.715625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:41.719371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 422/851] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:41.720148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:41.720275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:41.721124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:41.721976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 430/852] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:41.725505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.729737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.790736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.825882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff6f8f-262f-4fb5-bb1d-42e2c929b3d3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.829613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b207-6716-40c5-8cf1-d9ae908fc604 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:41.860070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.860701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.860984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.861261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.861842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.862939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:41.863240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.863541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:41.863822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:41.864098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:41.864905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=dc4349bca8444e65a321cf2bf2572ded) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:41.865128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:41.866540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:41.872330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:41.873255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:41.875457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:41.876217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 431/853] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/role_assignments?user.id=dc4349bca8444e65a321cf2bf2572ded&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:41.876290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 423/854] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:41.876366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.876435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:41.959491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:41.995409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73716fcf-849a-47a0-8568-4105c2276f49 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.002225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954099-d995-49c2-a9ca-5f0825d35ee6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.028351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.037351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.038050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.038336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.039259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.039875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.040179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.042342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.047304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.048931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.048931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.048931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.049655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.051284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.051893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 432/855] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.052557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:42.061344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:42.062351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:42.063785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 424/856] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:42.064864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.159577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f267-5da4-46d6-9274-62324cd4f3af None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.176272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e44805-7394-44f1-a752-8cd29b11c156 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.195112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.195721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.196001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.196272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.196906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.197210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.198559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.206613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 433/857] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.206613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.220226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.225734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.226973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.227254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.227525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.238132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.239619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:42.256230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:42.257211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:42.263252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:42.263252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:42.263252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:42.263252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 425/858] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:42.263252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.265937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.317525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6ca1d-a705-4da9-9e49-4e355f8f10ee None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.356111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.358163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.358163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.358163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.358163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.358163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.359591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.368598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 434/859] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.368598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.372296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4383c7-f277-45f8-bc65-862c53d0214d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.407486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.408088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.408378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.408638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.409374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.409676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.411076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.422603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 426/860] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.422603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.490066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e2db-803d-4e62-8daa-1a49b3418394 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.496218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.513098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.536614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.537586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.538022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.538446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.539330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.539641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.541032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.558532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 435/861] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.560082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.580501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98848e9-5f4f-4a3d-99dd-26f0876657b8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.629528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.630395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.631094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.631390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.632838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.633198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.634627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.642046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 427/862] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.676523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed044-f755-4f30-a859-e988a705e7dc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.717255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.717958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.718243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.718520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.726999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.728540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:42.742215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:42.743649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:42.745802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 436/863] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:42.753007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.859909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947f94-cf2b-4421-85cc-e7109e7689b3 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:42.873702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:42.896344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:42.896951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:42.897233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:42.897508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:42.898278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:42.898595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:42.900036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:42.918471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 428/864] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:42.927458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:42.974592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:43.035512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b155818-b808-4416-a40f-b6844e120f18 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:43.070160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:43.070798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.071082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.071357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.140738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:43.142193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:43.234996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:43.241656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 437/865] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:12:43.247765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:43.349884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffc4-d61e-4700-8ba3-e6a412e8d029 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:43.385090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:43.385943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.386380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.386812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.397184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:43.398829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:43.414211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:43.415385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:43.416447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:43.416447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:43.416447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:43.418144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 429/866] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:43.423811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:43.535165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb962-1f23-4be8-bf64-9f91c1524be3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:43.571318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:43.572082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.572508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.572853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.573606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:43.574005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:43.575539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:43.587966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 438/867] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:43.588246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:43.593318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:43.622997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:43.706779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebef3-b000-48bb-9c65-0cd0fa88ad18 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:43.745285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:43.745920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.746204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.746479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.753448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:43.754922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-584adac5-4a77-4660-bd24-e11623ffcd1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:43.765958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:43.766866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:43.768198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 430/868] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:43.772853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:43.878506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a33c-a354-4e5c-8ff1-5f411a677128 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:43.880356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f0af-be90-4c77-94c6-4236830dd65e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.880646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f0af-be90-4c77-94c6-4236830dd65e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.880927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34f0af-be90-4c77-94c6-4236830dd65e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.882933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 431/869] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:43.888155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.888650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.889113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.910483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:43.912363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:43.913855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:43.914594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:43.914984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:43.915356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:43.916146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:43.916519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:43.917930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:43.930796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 439/870] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:43.936459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:43.994868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:44.006695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 432/871] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:44.046162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94417ca-ef7e-45bf-a269-5480b5d7be92 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:44.081509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:44.082401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.082859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.083330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.084189 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c93e1c97e34048c3a49742d523b7eaf2) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:44.084651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:44.087172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:44.093672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 440/872] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:43 2022] GET /identity/v3/role_assignments?user.id=c93e1c97e34048c3a49742d523b7eaf2&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:44.306233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:44.322819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:44.412434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74eb4-977d-4e0f-b808-d71df5e486e0 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:44.469577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:44.470459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.470964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.471432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.472422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:44.474895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ad68ba87-d7bd-4bf6-a4b3-7a9db543fba9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:44.490993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:44.493458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:44.494480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 433/873] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:44.506025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:44.521646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae149b-2537-4761-ace4-089163ef9e9b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.522173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae149b-2537-4761-ace4-089163ef9e9b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.522640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae149b-2537-4761-ace4-089163ef9e9b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.525126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 434/874] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:44.531003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3106c-9715-4638-a7f4-1dbc208fd79e None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.531482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3106c-9715-4638-a7f4-1dbc208fd79e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.531935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3106c-9715-4638-a7f4-1dbc208fd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.563004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-42f3106c-9715-4638-a7f4-1dbc208fd79e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:44.565222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-42f3106c-9715-4638-a7f4-1dbc208fd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:44.671713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a65bc-0c94-4b40-b9eb-970bb1129779 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:44.686896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 435/875] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:44.688379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f90fd-a643-40e6-9719-1906847b01bb None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.688831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f90fd-a643-40e6-9719-1906847b01bb None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.689273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f90fd-a643-40e6-9719-1906847b01bb None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.690993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 436/876] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:44.700346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.700491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.700703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.706944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:44.716357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:44.721836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:44.722382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.722682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.722788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:44.722950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.723584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:44.723885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:44.724053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:44.725227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:44.732783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 441/877] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:44.737862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:44.799907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 437/878] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:44.862387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d331-42f4-4b03-8938-9997e169b2d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:44.896698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:44.897552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:44.898034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:44.898450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:44.899238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:44.899696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:44.901194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:44.906134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 442/879] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:44.969236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:45.071212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:45.082483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb9e3-97da-4f57-ad96-c5467b4b5095 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:45.125301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:45.125955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:45.126237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:45.126508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:45.127410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:45.128692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c90bc4-ee14-40b8-b969-6aab5c4de6a3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:45.133943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:45.136342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:45.154778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 438/880] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:44 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:45.201882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d55d-26bc-49d1-9473-15e1439e323d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:45.251771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:45.252682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:45.253113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:45.253591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:45.254400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:45.256036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213df0-cf85-40c9-8883-c66e2094f0aa None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:45.278597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 443/881] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:45 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:46.183441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c32f3d-88d7-4878-9dfe-5d464aca920e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.183850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c32f3d-88d7-4878-9dfe-5d464aca920e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.184055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c32f3d-88d7-4878-9dfe-5d464aca920e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.185609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 439/882] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:46.190825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.191220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.191381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.209944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:46.211450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:46.286040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 444/883] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:46.563540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c32f3d-88d7-4878-9dfe-5d464aca920e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:46.673875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c32f3d-88d7-4878-9dfe-5d464aca920e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:46.711390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:46.712031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.712313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.712582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.723218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:46.729126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:46.730053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:46.731364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 440/884] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:12:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:46.736561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:46.768465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:46.853412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda8ee0-6da0-4e42-9989-0817e3b80ead None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:46.890107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:46.891133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.891629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.892112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.892969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:46.893479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:46.895074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2154a44-5650-4540-872d-696344f7b787 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:46.905227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 445/885] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:12:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:46.910892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:46.911997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52332-1603-4859-8f9c-b5e309a82c11 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.912288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52332-1603-4859-8f9c-b5e309a82c11 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.912563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52332-1603-4859-8f9c-b5e309a82c11 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.914025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 446/886] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:46.919264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:46.919551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:46.919824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:46.942747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:46.944220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:46.982420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.038261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 447/887] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:47.040894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d41-cf92-4ec9-9ae9-84b3c50fdf77 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.078302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.078979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.079259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.079761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.091666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.093144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-50f3792c-6ceb-4798-ac95-093dcd66c90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:47.110126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:47.111118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:47.112016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:47.112016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:47.112016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:47.112016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 441/888] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:47.117929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.149808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.215773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512864-088c-470d-8bd9-0db7005f8ec9 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.216294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512864-088c-470d-8bd9-0db7005f8ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.216294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512864-088c-470d-8bd9-0db7005f8ec9 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.218287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 442/889] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:47.223717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.224297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.224690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.247345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee122d-849b-4d8e-996e-d43284de913a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.249035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:47.251355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:47.287644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.288554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.289500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.289938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.290825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:47.291332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.292900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.311375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 448/890] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:47.312289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.340827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 443/891] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:47.342762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.383103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.404385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.424627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390195-ac2c-411b-8923-0639727eaff4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.454839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913675-395c-4cb2-8109-36ee3723ed2a None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.458013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.458659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.458944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.459221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.459863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.461755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c85671-be30-414e-a64a-e020539d89ba None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.482625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 449/892] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:47 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:47.482625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d107-892c-4476-b157-67261055de99 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.482625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d107-892c-4476-b157-67261055de99 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.482625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d107-892c-4476-b157-67261055de99 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.482625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 450/893] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:47.486702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.486994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.487285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.508010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.508636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:47.509124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.509553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.509865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:47.510145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.518793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.520860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:47.535784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:47.536861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:47.537824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:47.542787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 444/894] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:47.543793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.613315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 451/895] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:47.613315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.666682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.675521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeaa4e-f78a-492b-8964-9ca7b0668f5e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.715009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.726601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.726601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.726601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.726601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.726995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:47.726995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.728032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.747864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924413-9dc4-48ca-990f-5bc25e01ab21 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.751276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 445/896] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:47.758037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.784384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.785198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.785553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.785878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.786472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.788147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:47.797696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:47.798657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:47.799550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 452/897] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:47.805298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.877869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421fe3-cdb2-48de-b4ae-62504b12ba1c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.912713 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80c344-68ec-43ec-9815-3bd0f75bb568 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:47.921488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.922380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.922691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.922972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.946809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.950350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:47.951331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:47.951614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:47.952042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:47.952669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:47.952964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.954324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:47.956633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:47.960043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 453/898] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:47.963449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:47.996308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:47.997765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.073315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ff33-613e-4722-b9fa-f43baddcf293 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.105544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 446/899] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:12:48.106462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.110047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.110703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.110991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.111265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.111846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.113203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:48.123310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:48.124314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:48.125158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 454/900] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:48.125929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.167251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.204157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.220348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1c1b4-592f-4c37-8c7e-fd136daca2c6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.246090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32865d98-e73e-4d42-9b53-752fcdeafc8f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.255029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.255636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.255918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.256203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.256833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.257139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.258529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.263404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 447/901] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.264175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.285449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.286180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.286594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.286891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.298041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.299558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:48.314951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:48.315885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:48.316775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:48.316775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:48.316775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:48.316775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 455/902] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:48.316996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.372720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec7b93-2f89-45f0-ae48-110909faa720 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.389178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.408310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.408917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.409213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.409509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.410080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.410380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.411805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.416697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 448/903] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.417744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.426781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f96430-e9be-403f-b106-926efbad5d99 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.445477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.467618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.468233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.468514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.468811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.469513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] RBAC: Adding query filter params (interface=public, service_id=b2b022ffd8244b60a3fe7600d9543711, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.469818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.471217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.478659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 456/904] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/endpoints?service_id=b2b022ffd8244b60a3fe7600d9543711&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.478659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.529475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe68-997c-48af-9ef0-c27cebecd460 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.564650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.565368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.565649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.565922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.566559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.566888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.568473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.577137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd6d3d-afcd-45c2-ab96-9944de5c2f6c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.586602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 449/905] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.586602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.615223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.615894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.616166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.616460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.617116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.617418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.618797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.629092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 457/906] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.629092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.633061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.675512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.699435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4699b-e85d-4f2b-9be5-b7a71cf0bbc4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.735684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.736288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.736571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.736855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.737138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221bad-c0d8-41a4-89b5-1dfdc08d5493 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.737460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.738856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.745734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 450/907] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:12:48.746352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.785761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.786405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.786722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.787003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.794882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.796372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:48.809967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:48.811008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:48.811901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:48.816305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 458/908] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:48.817270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.893039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7dc9-6431-4b61-b16b-63ab8c3c7a6a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.896497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.933608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2677d-1828-4ff7-a20a-e538f52a60ce None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:48.942842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:48.942991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.942991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.942991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.942991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.943365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] RBAC: Adding query filter params (interface=public, service_id=35d8de955c9a454a9bf26efb689a6d25, region_id=RegionOne) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.943628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.945523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:48.957447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 451/909] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/endpoints?service_id=35d8de955c9a454a9bf26efb689a6d25&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:48.963258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:48.983550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:48.984608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:48.984900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:48.985178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:48.985881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:48.986187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:48.988187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:49.003966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 459/910] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:49.013075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:49.088861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9585c-b005-4a2f-bbfd-e37ac4d280b1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:49.136839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:49.137788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:49.138079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:49.138358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:49.139000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:49.140301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395f4fc-0ac4-4439-9e78-042741e5ddab None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:49.140416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b704-0093-4a9e-8d29-63ccfc24403b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:49.158071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 452/911] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:48 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:12:49.200606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:49.201649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:49.202165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:49.202666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:49.203615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] RBAC: Adding query filter params (role.id=b6c4680466f44ff0b06c88562bb9d942, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c93e1c97e34048c3a49742d523b7eaf2) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:49.204116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:49.205811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366bf55-a8ab-4ede-94d1-74216abbab6d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:49.213302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 460/912] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:49 2022] GET /identity/v3/role_assignments?user.id=c93e1c97e34048c3a49742d523b7eaf2&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=b6c4680466f44ff0b06c88562bb9d942 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:49.478504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e722-8c30-40a8-a54d-e46b11fb9a7b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:49.479055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e722-8c30-40a8-a54d-e46b11fb9a7b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:49.479055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e722-8c30-40a8-a54d-e46b11fb9a7b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:49.480474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 453/913] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:49.485981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:49.486402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:49.486613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:49.505084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:49.506268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:49.530174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:49.576551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 461/914] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:49.846078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3e722-8c30-40a8-a54d-e46b11fb9a7b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:49.880748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:49.953263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3e722-8c30-40a8-a54d-e46b11fb9a7b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:49.987964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:49.988630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:49.988905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:49.989173 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:49.989744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:49.991218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:49.999817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:50.000782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:50.001610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 454/915] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:50.007870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:50.112144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f20c1-65ef-4c94-afe3-4dc6f603fe55 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:50.153327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:50.154299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.154811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.155289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.156119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:50.156640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:50.158208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:50.164345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 462/916] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:50.170596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:50.267796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:50.274037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d720-798a-46fa-8ee5-06628b488be8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:50.308861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:50.309578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.309860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.310136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.310831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:50.311133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:50.312576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:50.318969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 455/917] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:50.325822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:50.351373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:50.431721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eeedb-e3ff-4a5f-b583-b2c1f858f69c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:50.466114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:50.466805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.467093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.467368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.468067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] RBAC: Adding query filter params (interface=public, service_id=39babdab39654c4998f98f9e58774df0, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:50.468375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:50.469740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d095aaf-5ced-4044-8271-781499673206 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:50.475277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 463/918] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:12:50 2022] GET /identity/v3/endpoints?service_id=39babdab39654c4998f98f9e58774df0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:50.480869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:50.583618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a99-7251-4c01-b675-aa2e49e14c64 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:50.618884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:50.619846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.620318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.620793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.621594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:50.623227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d285f6-6201-4f1d-9e49-887de02bfe4d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:50.629766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 456/919] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:50 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:12:50.712908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48132-e021-4773-8438-38fe5c84751b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.713412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48132-e021-4773-8438-38fe5c84751b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.713412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48132-e021-4773-8438-38fe5c84751b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.714993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 464/920] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:50.720620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a747-ef06-4b35-8575-467b766abc4f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:50.720921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a747-ef06-4b35-8575-467b766abc4f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:50.721177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a747-ef06-4b35-8575-467b766abc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:50.740404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-dd03a747-ef06-4b35-8575-467b766abc4f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:50.741653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-dd03a747-ef06-4b35-8575-467b766abc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:50.761497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:50.820335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 457/921] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:51.090017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48132-e021-4773-8438-38fe5c84751b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.175680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19456d7-ca30-4627-9f0a-912b0061a7b0 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.176050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19456d7-ca30-4627-9f0a-912b0061a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.176233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19456d7-ca30-4627-9f0a-912b0061a7b0 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.186604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 458/922] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:51.186753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:51.186833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03ffc-93fe-497a-b389-38ae19cff256 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.186833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03ffc-93fe-497a-b389-38ae19cff256 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.186833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03ffc-93fe-497a-b389-38ae19cff256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.205955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b9f03ffc-93fe-497a-b389-38ae19cff256 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:51.206452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48132-e021-4773-8438-38fe5c84751b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.207183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b9f03ffc-93fe-497a-b389-38ae19cff256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:51.244738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.245372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.245654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.245933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.246544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.247937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0bc54927-6607-4210-8db3-c871c237a470 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:51.256673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:51.257644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.258618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 465/923] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:51.259412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07f74-96c6-4af0-9428-0e6d2d03350b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.259412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07f74-96c6-4af0-9428-0e6d2d03350b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.259530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07f74-96c6-4af0-9428-0e6d2d03350b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.260839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 466/924] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:51.265385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07f74-96c6-4af0-9428-0e6d2d03350b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.283429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 459/925] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:51.284952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.285441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.285907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.304700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:51.306277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:51.380857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 460/926] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:51.404833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07f74-96c6-4af0-9428-0e6d2d03350b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.440807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.441453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.441738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.442011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.442652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:51.443080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.444491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.454769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 467/927] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:51.458718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.475450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:51.553552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.568549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c182d-5824-4413-8e35-920abdd3fd25 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.571501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:51.613764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.614808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.615304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.615783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.616663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:51.617181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.618760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.629064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 461/928] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:51.630152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.675404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1e0c-92a6-4522-814c-aea473fb2932 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.715544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:51.715955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.716875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.717157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.717432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.718232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.720030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:51.728877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:51.729880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.730763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 468/929] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:51.732073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.745543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f923f-be70-4c00-a46f-599462114c6d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.786899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.788079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.788538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.788971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.789790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.792127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.826604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 462/930] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:51.826604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.827958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:51.853192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3a457-4e5f-4a62-98c1-68c6f717b58e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.915169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.915820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.916102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.916382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.932611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:51.939568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:51.940554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:51.941378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:51.942739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 469/931] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:51.947913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:51.949715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07b24-1783-42d9-8d3c-e9713c3f8a31 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:51.990490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:51.991183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:51.991474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:51.992286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:51.992918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:51.993220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:51.995484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:51.996285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.002886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 463/932] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:52.007136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.075839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa40748-cf52-4345-a22e-1263b53091c0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.122319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.123212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.123590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.123963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.124750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:52.125136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.126746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.128397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.138412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 470/933] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:12:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:52.143405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97532cd-3bca-4a1c-bcaf-33ac7e1222ae None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.143534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.188139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.188873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.189525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.189897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.191620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:52.192028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.193770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.202601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 464/934] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:52.206416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.264844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5896c4-f760-4c16-97f3-5cbecbc617b5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.280595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.300516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.301154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.301435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.301706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.313672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.315411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.328372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07a5fc-0b35-43d4-8fa5-4f40bd1dd194 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:52.329700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:52.330930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:52.332241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:52.332241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:52.332241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:52.332241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 471/935] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:52.336735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.370783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.371642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.372069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.372489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.373311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.374874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.391044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.398033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 465/936] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:52.459224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b4e-4061-410c-bc9d-0634a3121f65 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.506541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.507506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.507934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.508352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.509261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:52.509765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.511340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3dae-60b9-436e-8ff3-0b10d372fa9a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.526175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 472/937] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:52.532196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.626700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f59870-cd07-4533-9a92-b7da6c9b71dd None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.627047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f59870-cd07-4533-9a92-b7da6c9b71dd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.627262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f59870-cd07-4533-9a92-b7da6c9b71dd None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.629181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 473/938] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:52.634132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.634697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.635171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.648437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd539-bcc7-4bb1-90e9-5988ddd217e9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.660428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:52.660724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:52.677844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.705321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.706387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.706705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.706988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.718039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.720155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.733679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 474/939] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:52.735629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:52.736535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:52.737682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 466/940] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:52.742934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:52.778952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:52.853754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b214c-d85a-4923-a42f-34db236d3c7b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:52.889108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:52.889728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:52.890013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:52.890288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:52.891053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:52.891359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:52.892786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:52.911490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 475/941] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:52.917049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.014595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.024259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af23f9-6860-4421-90f3-c727e4ddb01f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.060345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.061125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.061507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.061849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.073427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.074984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:53.091825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:53.092796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:53.093671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:53.093671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:53.093671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:53.095475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 467/942] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:53.101886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.126673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.138866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d16d0-ebd9-42b0-96b9-348b5402dc94 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.140658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.183602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.184503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.184982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.185527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.186462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.188247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:53.198432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:53.199544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:53.200420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:53.203139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 476/943] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:53.208443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.232509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110b412-128c-4d30-b453-084ccd608fe9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.276044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.276585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.276872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.277144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.278142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:53.278707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.280091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.297144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 468/944] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:53.298045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.322418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32428-12ce-4006-a0a1-d8e2dae917c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.360223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.361322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.361852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.362322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.363183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:53.363681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.365418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.371829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 477/945] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:53.381164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.391836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.403268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e28638-f53d-4d94-a88f-a0b62feb7c60 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.408423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.441760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.442399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.442709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.442988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.450437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.452151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:53.465100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:53.466184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:53.467179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:53.471279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 469/946] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:53.472218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.505780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6e5d0-cda6-4b10-8f60-07effa63792a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.558793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.559327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.559620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.559946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.561093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:53.561404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.562780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.570650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 478/947] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:53.575765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.612706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d171-08e3-418a-bb97-23125ce7dd42 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.660550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.661388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.661773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.662055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.663110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:53.663524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.664986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.682703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 470/948] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:53.686956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:53.703185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.707829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.727752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64ef4b-29a7-4cc0-9d91-cf22232a2549 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.765045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.765646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.765867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.766145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.766852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.768387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e0c1e-5c63-448d-af35-6222e7c8ca52 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.798616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 479/949] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:53.815448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28be14d-7ae7-47ca-a84a-f94ada52b488 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:53.861679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:53.862345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.862644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.862917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c93e1c97e34048c3a49742d523b7eaf2/roles/b6c4680466f44ff0b06c88562bb9d942` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.865111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=c93e1c97e34048c3a49742d523b7eaf2, role_id=b6c4680466f44ff0b06c88562bb9d942)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:53.866643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979ff3-f72f-439e-87dd-2631cfc4963a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:53.883372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c95c-0b08-4a24-bc44-6f718e9b14b5 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.883685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c95c-0b08-4a24-bc44-6f718e9b14b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.883933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c95c-0b08-4a24-bc44-6f718e9b14b5 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.884604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 471/950] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:12:53 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c93e1c97e34048c3a49742d523b7eaf2/roles/b6c4680466f44ff0b06c88562bb9d942 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:12:53.885416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 480/951] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:53.891665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:53.892019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:53.892253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:53.913065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:53.914328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:53.986539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:53.997511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 472/952] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:54.274679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334c95c-0b08-4a24-bc44-6f718e9b14b5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:54.382155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334c95c-0b08-4a24-bc44-6f718e9b14b5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:54.417904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:54.418938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:54.419422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:54.419895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] PATH_INFO: `/v3/services/compute` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:54.420670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:54.422225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-766cfe6a-088e-4308-a83f-b0b78aaa19be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:54.432014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:54.432998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:12:54.433846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:54.436581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 481/953] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:54.442655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:54.489129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac4f10-9b98-42cd-aea3-dfd79c9edc2e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:54.489771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac4f10-9b98-42cd-aea3-dfd79c9edc2e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:54.490248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac4f10-9b98-42cd-aea3-dfd79c9edc2e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:54.492955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 482/954] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:12:54.498100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:54.498720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:54.499199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:54.507602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:54.518822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:54.520263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:54.553720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6ed1a-d16a-4149-b8a9-134596088f14 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:54.591937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:54.592965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:54.593473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:54.593889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:54.594772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:54.601852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 483/955] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:12:54.601978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:54.601978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:54.606318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 473/956] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:54.612117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:54.712925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8c162-5586-4daa-a19d-eb633c9313d7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:54.748582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:54.749480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:54.749963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:54.750461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:54.751322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:54.751856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:54.753462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:54.758592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 484/957] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:54.762650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:54.875691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:54.939432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:54.981428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bed64-e136-43d8-a5c3-c8263b83328e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:55.016667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:55.017285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.017565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.017837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.018497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:55.019973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:55.022602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING keystone.server.flask.common [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 02:12:55.041665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.sql.core [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:12:55.041665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 02:12:55.041665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [parameters: {'id': 'b5bcbf14e7db4dd8a4936872e59a2fd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 02:12:55.041665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81528) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b5bcbf14e7db4dd8a4936872e59a2fd3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b5bcbf14e7db4dd8a4936872e59a2fd3. Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:55.058543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 02:12:55.059384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application yield resource Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise self.value Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application session.commit() Aug 19 02:12:55.060331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.session.flush() Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application compat.raise_( Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 02:12:55.061211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 02:12:55.062246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:55.063109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [parameters: {'id': 'b5bcbf14e7db4dd8a4936872e59a2fd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:55.064005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:55.064836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b5bcbf14e7db4dd8a4936872e59a2fd3. Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:55.065870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 474/958] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Aug 19 02:12:54 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:55.068321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:55.173146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870127f4-4b2d-4d4c-979c-039384aea53e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:55.208140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:55.208868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.209336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.209656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.217443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:55.219122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c3bfa031-fb4d-494c-ba46-5ab5cad937e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:55.230391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:55.231273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:55.232248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 485/959] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:55.239494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:55.349549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf5987-1085-4896-87f4-4030ad85ef2e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:55.371251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:55.385686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:55.386300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.386600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.386894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.388010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:55.388573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:55.390231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686c313-9eb4-4c04-983f-996b2f297032 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:55.413832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 475/960] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:12:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:55.780645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34373d0-9801-484b-a3db-6773385f5e07 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.780983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34373d0-9801-484b-a3db-6773385f5e07 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.781312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34373d0-9801-484b-a3db-6773385f5e07 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.782976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 486/961] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:55.788876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a537-1e61-4bcf-b75e-45e1513401e2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.789172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a537-1e61-4bcf-b75e-45e1513401e2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.789447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a537-1e61-4bcf-b75e-45e1513401e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.808918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3577a537-1e61-4bcf-b75e-45e1513401e2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:55.810521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3577a537-1e61-4bcf-b75e-45e1513401e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:55.890687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 476/962] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:55.896994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361cdd-f8d1-4add-9781-22f99b3c4e83 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.897288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361cdd-f8d1-4add-9781-22f99b3c4e83 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.897568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361cdd-f8d1-4add-9781-22f99b3c4e83 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.898955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 487/963] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:55.904353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:55.904646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:55.904923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:55.923576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:55.924758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:55.996377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 477/964] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:56.167908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361cdd-f8d1-4add-9781-22f99b3c4e83 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.237216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.274497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.281886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361cdd-f8d1-4add-9781-22f99b3c4e83 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.313130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.327278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.328019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.328306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.328585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.329276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.330731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:56.341170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:56.342262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:56.343183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:56.347431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 488/965] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:56.348360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.395141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9162-a1d2-4b18-9d37-c0cbf4abeca9 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.432343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62716790-1054-46db-b016-b8037036b08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.432905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62716790-1054-46db-b016-b8037036b08d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.433187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62716790-1054-46db-b016-b8037036b08d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.433458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62716790-1054-46db-b016-b8037036b08d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.444215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62716790-1054-46db-b016-b8037036b08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-62716790-1054-46db-b016-b8037036b08d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:12:56.448974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:56.450897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:56.452021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 478/966] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:56.459780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62716790-1054-46db-b016-b8037036b08d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.467884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93248898-d944-4264-9b13-32ae6ec773e7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.495518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.509197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.509859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.510256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.510809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.511453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:56.511758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.513146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.524028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 489/967] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:56.525470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.580498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.589105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62716790-1054-46db-b016-b8037036b08d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.624377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.624976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.625256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.626200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.626200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:56.626457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.627867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.641587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 479/968] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:56.642874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.665309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e34af-505d-4fe8-8ac8-03621575ea10 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.702125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.702702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.702986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.703320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.703957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:56.704258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.705721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.716851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 490/969] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:56.717819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.770720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.795597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ce449-f67c-4f67-8b76-b1784f7b58ae None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.827217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fad90-fc2a-4954-b22b-529a90d04cfc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:56.841952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.842610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.842883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.843158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.853455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.854934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.864423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:56.865026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.865311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.865589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.866292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] RBAC: Adding query filter params (interface=admin, service_id=39babdab39654c4998f98f9e58774df0, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:56.866739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:56.868083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f23b51-6cbb-452e-8563-c2d6197f553a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-a5889b3f-387d-409b-9351-1398c9116911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:56.869796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:56.870763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:56.871750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:56.871750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:56.871750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:56.871750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 480/970] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:56.872875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8c94-6d34-4b9f-9808-3f425fa6923c None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.872875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8c94-6d34-4b9f-9808-3f425fa6923c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.872875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8c94-6d34-4b9f-9808-3f425fa6923c None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.874012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 481/971] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:56.878288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 491/972] 10.222.0.45 () {56 vars in 1249 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/endpoints?service_id=39babdab39654c4998f98f9e58774df0&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:56.883561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8c94-6d34-4b9f-9808-3f425fa6923c None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.883699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:56.883699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:56.883699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:56.898891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:56.899397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:56.900546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:56.973263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 492/973] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:56.979477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:56.995154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8c94-6d34-4b9f-9808-3f425fa6923c None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.031368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.031977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.032260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.032593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.033243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:57.033549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.035069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.041711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.052655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 482/974] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:57.053562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.112886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d92ba-d38c-4a2c-b19c-58f4d7b45a78 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.130301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.160552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.161635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.162392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.163095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.163913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.165935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.171332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddc12-3f7d-4ec6-b818-e34d818a869e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.175315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 493/975] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:12:56 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:12:57.217785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.218497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.218819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.219095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.227983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.229506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:57.242797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:57.243853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:57.245468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 483/976] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:12:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:57.249881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.251796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.376414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9f9b-bc36-48dd-8d56-6348980a3deb None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.382510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac65ea-5258-458e-8387-f01f62216aa3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.392281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.418684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.419423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.420180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.420554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.420834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.421509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.422908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d02db5-fa54-43fd-9ab6-546d67bc70ca None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.425563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.426244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.426434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.426747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.427696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:57.427868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.429773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.439340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 494/977] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:12:57 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:12:57.440586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04969dac-9079-43b7-b4a5-7e6f7f1b78bc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.440874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04969dac-9079-43b7-b4a5-7e6f7f1b78bc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.441150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04969dac-9079-43b7-b4a5-7e6f7f1b78bc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.447405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 495/978] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:57.451231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 484/979] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 19 02:12:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:57.452568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.453111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.453587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.457322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.479511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:57.481537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:57.576325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 496/980] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:57.608457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151010d-94b8-4919-919d-fdf7cdd1d14d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.646212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:57.646875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:57.647159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:57.647437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:57.707700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.721923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:57.723415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:57.831506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 485/981] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:12:57 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:12:57.837623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.847687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:57.954148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.955599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:57.968742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cefd-909f-4cad-81ca-d918c71bec40 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:57.970247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47544e9-3372-41fe-bb11-ec373053da6c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.006553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.007220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.007510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.007795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.008425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.009972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.013015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.013803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.014239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.014700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.025501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.sql.core [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:12:58.025501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 02:12:58.025501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [parameters: {'user_id': 'e3fb507f2c2e4d6180940a925eeac8eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 02:12:58.025501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81528) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 02:12:58.028161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.029769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:58.033105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:58.034168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application yield resource Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application next(self.gen) Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise self.value Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application session.commit() Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 02:12:58.040229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.session.flush() Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application compat.raise_( Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 02:12:58.041186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 02:12:58.042194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application conn.query(q) Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application result.read() Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 02:12:58.043090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e3fb507f2c2e4d6180940a925eeac8eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:58.043988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 02:12:58.045014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 486/982] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 19 02:12:57 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:58.045994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:12:58.053552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:58.054834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:12:58.055923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:12:58.055923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:12:58.055923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:58.058205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 497/983] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:58.059139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.171710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818881-b112-456d-976a-a03f0d8dc296 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.173161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af74f-fbc4-49ba-80e6-b05c7488aa5d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.218593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.218593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.218593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.218593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.219211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.219732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.219975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.220243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.220998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:58.221378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.222763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.226661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.228305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.235943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 498/984] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:12:58.239934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:58.240880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:12:58.242447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 487/985] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:58.247454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.247631 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.259468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:58.261233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:58.368215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88088a-389e-4760-8b44-7bbc361270e6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.383447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0fad-2ad2-4635-b607-93aa6994ba6f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.416220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.417199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.417797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.418248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.419125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.419271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:58.419744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.420037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.420414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.420786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.421862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.427964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.430056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:12:58.441969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:58.443220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:12:58.444348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:58.450534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 499/986] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:12:58.451301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.477573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 488/987] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:58.528389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:58.571107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc0aac-e1dc-4faf-8d07-e5b7d1ed2621 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.612105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.613096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.613604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.614085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.615023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:58.615558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.617257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ec889-6b64-40d5-9021-384732873b90 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.632159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 500/988] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:12:58.638158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:58.710715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:58.748120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b138-db8c-4292-a66e-7a02ee8d020d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:58.784415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:58.785029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:58.785313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:58.785592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:58.786316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] RBAC: Adding query filter params (role.id=b6c4680466f44ff0b06c88562bb9d942, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c93e1c97e34048c3a49742d523b7eaf2) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:58.786721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:58.788152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552bc4-b988-4c51-9598-23481ab14928 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:58.795022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 489/989] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:12:58 2022] GET /identity/v3/role_assignments?user.id=c93e1c97e34048c3a49742d523b7eaf2&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=b6c4680466f44ff0b06c88562bb9d942 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:59.178097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be9c6b-153d-4075-9351-53a9dea01511 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.178850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be9c6b-153d-4075-9351-53a9dea01511 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.179849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be9c6b-153d-4075-9351-53a9dea01511 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.181645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 501/990] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:59.187006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806422cd-a208-4d82-a465-e09855e0f52a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.187394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806422cd-a208-4d82-a465-e09855e0f52a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.187573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806422cd-a208-4d82-a465-e09855e0f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.206162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-806422cd-a208-4d82-a465-e09855e0f52a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:59.207679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-806422cd-a208-4d82-a465-e09855e0f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:59.275563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 490/991] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:59.465795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cd9e-5fb8-449c-b53d-c87092c66bc3 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.466321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cd9e-5fb8-449c-b53d-c87092c66bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.466321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967cd9e-5fb8-449c-b53d-c87092c66bc3 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.467748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 502/992] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:12:59.472806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.473098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.473377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.490990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:12:59.492696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:12:59.537963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967cd9e-5fb8-449c-b53d-c87092c66bc3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:59.549533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:59.562761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 491/993] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:12:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:12:59.637569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967cd9e-5fb8-449c-b53d-c87092c66bc3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:59.662196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:59.672112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:59.672733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.673010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.673348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.673852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:59.675216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:12:59.684223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:12:59.685272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 02:12:59.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:12:59.690607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 503/994] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 19 02:12:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:12:59.691318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:59.792784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440e7d8-471d-4ede-98c5-ccdc0d8ab520 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:59.827396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:59.828004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.828287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.828558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.829187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:59.829489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:59.830878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:59.840715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 492/995] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:59.840871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:59.842696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:12:59.900920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:12:59.949657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543284c-9ee5-4129-b02d-6238d7565bbc None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:59.961651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fcdc9-d645-4eaf-9fda-3e6033e4c7a6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:12:59.984908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:12:59.985589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:12:59.985868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:12:59.986136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:12:59.986792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:12:59.987090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:12:59.988442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:12:59.993561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 493/996] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 19 02:12:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:12:59.998904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:00.000285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.000922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.001465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.001746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.003096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.004450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:00.012964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:00.013993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:00.015632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 504/997] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:12:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:00.019619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:00.079928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:00.107287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf83c2-445e-4a4a-93ac-797db8c4cc5f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:00.128416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:00.131859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2df047-4623-4c56-a481-a9d973d4451e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:00.147013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.148485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.149398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.149711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.150680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.152064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.167937 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.168589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.168864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.169374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 494/998] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:12:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:13:00.170693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.171567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:00.172086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.173744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.182766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 505/999] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:13:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:00.188233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:00.310208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e9551-1479-46f5-a9c9-5d3ccd954025 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:00.346321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.346923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.347206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.347484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.348119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] RBAC: Adding query filter params (type=compute) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:00.348453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.349802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.355206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 495/1000] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:13:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:00.361238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:00.463200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fa34-2f61-4c49-a29c-90def649b28d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:00.479905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:00.498148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.498793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.499068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.499346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.500043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] RBAC: Adding query filter params (interface=public, service_id=ae7f438399034e8bb88565ac91fc50e0, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:00.500354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.501714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd1fdd-4b52-4c2f-805c-c6b7553b8516 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.511760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 506/1001] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:13:00 2022] GET /identity/v3/endpoints?service_id=ae7f438399034e8bb88565ac91fc50e0&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:00.513099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:00.556257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:00.618941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fbe2-bd73-4278-89dd-703c2b2664da None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:00.655233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:00.655858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.656141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.656421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.657028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:00.658396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14915998-f1b2-47eb-9d6a-1670726ea468 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:00.664897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 496/1002] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:13:00 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:13:00.728601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56447769-c067-482b-ae88-22da57a93e49 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.728887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56447769-c067-482b-ae88-22da57a93e49 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.729169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56447769-c067-482b-ae88-22da57a93e49 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.730521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 507/1003] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:00.736094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:00.736384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:00.736667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:00.755849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:00.757147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:00.832176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 497/1004] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:01.099831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56447769-c067-482b-ae88-22da57a93e49 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:01.208740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56447769-c067-482b-ae88-22da57a93e49 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:01.244647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:01.246307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:01.246307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:01.246307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] PATH_INFO: `/v3/services/image` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:01.246541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:01.247867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:01.256810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:01.257819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:01.258702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 508/1005] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 19 02:13:01 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:01.264570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:01.301446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:01.373737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998eb3-658b-49e4-a7a5-cb89cc9a4593 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:01.408311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:01.408909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:01.409297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:01.409580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:01.410209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] RBAC: Adding query filter params (name=image) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:01.410513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:01.411899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc1a43-cc6a-49e6-b84d-bb47381daf6f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:01.422134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 498/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:01.423110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:01.470759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:01.525245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021337bb-fe0c-4ab1-979a-cf588ef15328 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:01.559541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:01.560194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:01.560500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:01.560828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:01.561464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] RBAC: Adding query filter params (type=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:01.561770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:01.563284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b9f1-0353-4e00-b1c7-6f643cf7c362 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:01.568136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 509/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:02.112033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f19a7-e1da-4ea4-8361-84a74e517fbd None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.112319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f19a7-e1da-4ea4-8361-84a74e517fbd None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.112606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f19a7-e1da-4ea4-8361-84a74e517fbd None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.113963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 499/1008] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:02.119131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295b53-bfd3-4daa-9395-c9e15f435120 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.119416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295b53-bfd3-4daa-9395-c9e15f435120 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.119690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295b53-bfd3-4daa-9395-c9e15f435120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.137850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4f295b53-bfd3-4daa-9395-c9e15f435120 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:02.139060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4f295b53-bfd3-4daa-9395-c9e15f435120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:02.209143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 510/1009] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:02.476902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f19a7-e1da-4ea4-8361-84a74e517fbd None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:02.569014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2392-beb2-40b1-b0d4-052c98f73435 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.570074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2392-beb2-40b1-b0d4-052c98f73435 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.570171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2392-beb2-40b1-b0d4-052c98f73435 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.571687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 511/1010] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:13:02.576639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:02.577025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.577307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.577636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.582468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f19a7-e1da-4ea4-8361-84a74e517fbd None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:02.597523 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:02.598852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:02.622309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:02.623006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.623285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.623555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.624703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:02.626166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:02.627897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 500/1011] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:02.634424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:02.638443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:02.672414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 512/1012] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:13:02.733833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304fd49-cb30-4381-8ede-2c96eaff9bb1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:02.766769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:02.767368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:02.767650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:02.767928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:02.768561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:02.770061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:02.802594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 501/1013] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:13:02 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:13:02.937495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:03.047124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87930-f6ae-40a4-a9f7-01ec5da3eade None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:03.081221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:03.081846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.082119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.082385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.082984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:03.084333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:03.093288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:03.094256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 02:13:03.095140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:03.096448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 513/1014] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:13:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:03.100535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:03.120213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:03.206689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013170-f9f2-49af-9276-57e11457aa89 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:03.240329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:03.240936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.241212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.242022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.242677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:03.242977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:03.244329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:03.249379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 502/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:13:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:03.254974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:03.294780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:03.362793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc28f0-6c6d-418d-a8e2-3f56225913fe None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:03.395704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:03.396310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.396592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.396864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.397484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:03.397810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:03.399195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a9e4-2aa8-4ded-b3c3-b623e0bbde1d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:03.408508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 514/1016] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 19 02:13:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:03.410033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:03.477049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d40b-d2aa-4fd6-863c-aaa1a2c8a1b6 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.477328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d40b-d2aa-4fd6-863c-aaa1a2c8a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.477601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701d40b-d2aa-4fd6-863c-aaa1a2c8a1b6 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.479122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 515/1017] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:03.483848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.484131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.484405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.496036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:03.502759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:03.503951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:03.515644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25ace7-d938-47b7-9c91-190872b665ef None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:03.552705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:03.553308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.553589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.553912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.555104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:03.556784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb041f-4e7d-4809-ae69-fffc86c230e3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:03.572367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 516/1018] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:13:03.590627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 503/1019] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:13:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:03.848659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:03.877544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:03.953425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d644d-e6d1-480c-8e14-9482f171a09f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:03.994549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:03.995177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:03.995458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:03.995756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:03.996360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:03.997716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b929b-16cc-4b69-a20c-d839b4a84185 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:04.014446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 517/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:13:03 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:04.749534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9ea8c-fce3-4a31-ae44-18eb17aa92e0 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:04.750083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9ea8c-fce3-4a31-ae44-18eb17aa92e0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:04.750083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9ea8c-fce3-4a31-ae44-18eb17aa92e0 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:04.751753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 504/1021] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:04.757401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:04.757957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:04.757957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:04.776624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:04.777838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:04.852442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 518/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:05.123935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9ea8c-fce3-4a31-ae44-18eb17aa92e0 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:05.236193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9ea8c-fce3-4a31-ae44-18eb17aa92e0 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:05.269803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:05.270433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.270745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.271020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.272135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:05.273598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212670b-e95f-416c-aed2-ffb2cc26c495 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:05.280081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 505/1023] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:05.281292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:05.293359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:05.383892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325d6a8-f49c-43b0-9e80-3ad517a46a53 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:05.417079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:05.417684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.417956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.418231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.418912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:05.420340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98204090-26cf-460d-b371-fb2a92da2cf0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:05.450599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 519/1024] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:13:05 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:05.589248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85cdef-1228-40eb-ae17-c7d0e2ea24af None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.589578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85cdef-1228-40eb-ae17-c7d0e2ea24af None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.589802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85cdef-1228-40eb-ae17-c7d0e2ea24af None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.591180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 506/1025] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:05.596429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b360-e3ea-41c1-b47d-28e93f2bbf72 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.596712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b360-e3ea-41c1-b47d-28e93f2bbf72 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.596984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b360-e3ea-41c1-b47d-28e93f2bbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.615640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3af4b360-e3ea-41c1-b47d-28e93f2bbf72 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:05.616857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3af4b360-e3ea-41c1-b47d-28e93f2bbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:05.678515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:05.688378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 520/1026] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:13:05.931789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e172-f712-470e-9d84-374aa339c1e5 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.932279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e172-f712-470e-9d84-374aa339c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.932279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e172-f712-470e-9d84-374aa339c1e5 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.933676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 507/1027] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:05.938810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:05.939202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:05.939384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:05.957732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:05.958950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:05.965983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e172-f712-470e-9d84-374aa339c1e5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:05.974676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.033873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 521/1028] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:06.076311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e172-f712-470e-9d84-374aa339c1e5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.112260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.112890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.113176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.113454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.123945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:06.128591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:06.129541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:06.130401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 508/1029] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:06.136285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.242389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ac02-27b5-42d9-abb9-829c2f7bcee8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.271849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.282024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.282649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.282928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.283196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.283848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.284145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.285485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.293213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 522/1030] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:06.299010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.303351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.368744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.405517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae034-24f5-47e6-aafc-30556d73b4df None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.405734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa560-7d5e-46da-934d-a7ba523b5dec None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.441448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.442004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.442288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.442460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.442611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.443069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.443331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.443439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.443602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.445305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:06.454145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:06.455372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:06.456237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:06.456977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.456977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.460411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 523/1031] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:06.461367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:06.472679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:06.473669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:06.474555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:06.474555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:06.474555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:06.478738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 509/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:06.479790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.521791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.572756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b0a0-ca72-44b5-945b-8b7a5df708e1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.584519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992caf9-24cb-46f1-8a7b-af68eb1e1276 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.605590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.612685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.613154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.613489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.613763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.614315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.614642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.616225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.627128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 524/1033] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:06.627858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.630004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.630638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.630929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.631212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.631858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.632767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.634136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.651184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 510/1034] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:06.652424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.736651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea68da-bd9c-40d4-aff5-b1649f2f3ca2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.753219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638112f-eb51-47c8-b8e0-55512df16597 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.753365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.772648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.773339 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.773689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.774034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.775111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] RBAC: Adding query filter params (type=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.775477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.776809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.781697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 525/1035] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:06.787449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.794326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.794985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.795265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.795536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.803294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.805278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:13:06.817476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:06.818462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:06.819511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 511/1036] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:06.824589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.865861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.892074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852d7a4-8313-45ac-b0f6-f51180248592 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.929528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.930245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.930519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.930831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.931503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] RBAC: Adding query filter params (interface=public, service_id=6ada416f876c4f87970e5af16e9838c9, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.931804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.932888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dfe3f-33db-4340-bd29-caccafc6c854 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:06.933343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.942881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 526/1037] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/endpoints?service_id=6ada416f876c4f87970e5af16e9838c9&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:06.944718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:06.968285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:06.968888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:06.969168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:06.969438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:06.970328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:06.970516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:06.971980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:06.995162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 512/1038] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:06.996167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:06.996629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.051382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab15cc-aa29-4e12-8132-6ed2ea4b9a6c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.089423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.090023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.090298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.090581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.091192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:07.092538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:07.098632 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:07.099296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 527/1039] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:13:07.113678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adc779-aee2-4ab4-b106-9664a034c1a1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.157330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.157957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.158250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.158592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.236474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:07.237933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a822a6-0c3f-4efe-a6fc-40e283501741 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:07.329975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:07.338835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 513/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:13:07.344404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.428193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed991a-f4c9-4cd7-990d-452c08fb6cf2 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.428519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed991a-f4c9-4cd7-990d-452c08fb6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.428756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed991a-f4c9-4cd7-990d-452c08fb6cf2 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.430146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 514/1041] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:13:07.435793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.436230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.436714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.447621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94693f7-3c63-4803-ab74-112faeef7c91 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.457591 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:07.459879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:07.462073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:07.486251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.486931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.487215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.487489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.499112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:07.500538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:07.516432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:07.517401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:07.523749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:07.523749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:07.523749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:07.523749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 528/1042] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:07.523995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.542617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 515/1043] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:07.625906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde28765-6d11-4601-a306-7f8bc72fcf0e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.659152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.659753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.660033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.660307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.660939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:07.661239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:07.662608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:07.674256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 529/1044] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:07.679699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.778250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9549-4aac-4736-89a7-babc474a553f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.809601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:07.815970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.824903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.825539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.825822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.826098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.832985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:07.834417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:07.840054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:13:07.847769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:07.848669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:07.850336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 516/1045] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:07.854491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.923121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf904d-9e09-4731-ad4e-0e45fa473c87 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.957393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62b473-2da0-4f11-b841-982483f937aa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:07.957915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.958525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.958839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.959119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.969522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:07.974221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:07.975263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:07.976528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 530/1046] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:07.981361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:07.996683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:07.997291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:07.997573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:07.997846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:07.998533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:07.998871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.000297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.013123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 517/1047] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:08.018802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:08.063383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:08.067927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:08.087471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6699c-a226-41c2-a233-18e0f9fe6ee5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.121487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f2e1-207a-4f5d-8390-1dcd2365c94f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.123510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.124241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.124519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.124792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.125445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:08.125741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.127132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.141281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 531/1048] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:08.142365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:08.165633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.166391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.166772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.167056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.167795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] RBAC: Adding query filter params (role.id=b6c4680466f44ff0b06c88562bb9d942, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:08.168094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.169526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.186703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 518/1049] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:08 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=b6c4680466f44ff0b06c88562bb9d942 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:08.264388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd3a77-5688-4f33-8c6a-cf9f8d36a037 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.299972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.300620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.300903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.301180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] PATH_INFO: `/v3/users/4c38d29b691749a2b9288f7abfbc8a32` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.316516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:08.319798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] RBAC: Authorizing `identity:get_user(user_id=4c38d29b691749a2b9288f7abfbc8a32)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.321641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.323371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 532/1050] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:08 2022] GET /identity/v3/users/4c38d29b691749a2b9288f7abfbc8a32 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:08.329431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:08.430556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826cc4-33f6-4622-a53c-dee9ff8eec9c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.441104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:08.465633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.466390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.466800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.467174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.533553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.535202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.639256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 519/1051] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:13:08.641009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:08.742663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac89b9-6330-40a7-90b7-8755e344f696 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.775966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.776599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.776890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.777164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.778277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.779743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea39fb5-b329-4747-8f06-87076e9b4d4f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.786315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 533/1052] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:08 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:08.787777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:08.799995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:08.889819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4c27-c1ac-4ee2-b3f7-0a8e609c6f81 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:08.924610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:08.925207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:08.925483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:08.925752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:08.926460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=d382cc801056437190cb1facf13206ec, user.id=4c38d29b691749a2b9288f7abfbc8a32) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:08.926798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:08.928209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098ddc5-70ab-4de6-90b5-4e9161ea7a39 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:08.933772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 520/1053] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:08 2022] GET /identity/v3/role_assignments?user.id=4c38d29b691749a2b9288f7abfbc8a32&scope.project.id=d382cc801056437190cb1facf13206ec&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:09.014800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2d06-deb5-4225-9471-c88ef7507cf6 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.015317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2d06-deb5-4225-9471-c88ef7507cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.015317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2d06-deb5-4225-9471-c88ef7507cf6 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.016765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 534/1054] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:09.022138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.023314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.023314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.042031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:09.043282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:09.112425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 521/1055] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:09.378237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d2d06-deb5-4225-9471-c88ef7507cf6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:09.446065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:09.481315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d2d06-deb5-4225-9471-c88ef7507cf6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:09.516292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:09.516921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.517200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.517474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] PATH_INFO: `/v3/services/image` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.518048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:09.519432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:09.528311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:09.529317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:09.531647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 535/1056] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 19 02:13:09 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:09.535306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:09.538463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:09.635981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7498b-00b9-47d3-a3e5-068249752ebd None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:09.668916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:09.669521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.669805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.670078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.670739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] RBAC: Adding query filter params (name=image) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:09.671047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:09.672405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:09.682270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 522/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:09.683525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:09.785546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0a8c-2ea6-47ec-901b-ec850e30d44e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:09.815182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:09.821360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:09.821972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.822256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.822521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.823181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:09.823485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:09.824840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75b0c0-3436-4251-bf78-b25d5af0e5a7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:09.834195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 536/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:09.835420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:09.904884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:09.941217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995fb6a-8f62-48fa-ae7b-43274d54e01f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:09.974810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:09.975410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:09.976241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:09.976552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:09.977159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:09.978511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458782-1e61-4331-b11e-df10afc4b9a8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:10.004814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 523/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:13:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:10.079913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196399-fa87-4bb1-be84-555c993f5a8f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.080456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196399-fa87-4bb1-be84-555c993f5a8f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.080456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196399-fa87-4bb1-be84-555c993f5a8f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.082010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 537/1060] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:10.088287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.088791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.088889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.108010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:10.109245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:10.189320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 524/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:10.458778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196399-fa87-4bb1-be84-555c993f5a8f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:10.560595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196399-fa87-4bb1-be84-555c993f5a8f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:10.595030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:10.595665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.595947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.596221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.606213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:10.610907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:10.611824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:10.612702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:10.614647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 538/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:13:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:10.618287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:10.668472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:10.720319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786f44c-9d8e-48fe-be82-817def611590 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:10.753186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:10.753796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.754080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.754355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.755041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:10.755345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:10.756705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7b46-9646-4195-beb8-80e14f263f30 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:10.765458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 525/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:10.771131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:10.824810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117158-98ea-4ab4-9a58-8626373c2017 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.825113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117158-98ea-4ab4-9a58-8626373c2017 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.825378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117158-98ea-4ab4-9a58-8626373c2017 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.826996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 526/1064] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:13:10.829974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:10.831809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6da475-e773-42cd-b635-46931610509f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.832060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6da475-e773-42cd-b635-46931610509f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.832342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6da475-e773-42cd-b635-46931610509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.850073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-ab6da475-e773-42cd-b635-46931610509f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:10.851325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ab6da475-e773-42cd-b635-46931610509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:10.877570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47c7f-dc83-4fb7-8f60-4b340a977ffe None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:10.911920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:10.912543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:10.912823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:10.913113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:10.923258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:10.924809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:10.930023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 527/1065] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:10.942395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:10.943378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:10.944272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:10.944272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:10.944272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:10.944272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 539/1066] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:10.950022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6da475-e773-42cd-b635-46931610509f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:10.994380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.052065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6da475-e773-42cd-b635-46931610509f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.086904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.087513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.087794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.088068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.088708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:11.089246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.090365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.102722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 528/1067] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:11.108540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.199977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.217187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147526fc-843d-4571-9ced-b3431f253bc1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.227540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.256378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.257077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.257355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.257633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.265515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.267214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:13:11.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:11.279562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:11.280490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 540/1068] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:11.285516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.302478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b42232-c2da-40bb-8623-74e0e4957d49 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.304588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.337203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.337831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.338112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.338383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.349052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:11.354236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:11.355395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:11.356516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:11.360417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 529/1069] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:11.361255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.397033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae6912-77e3-4abb-bd9d-2cd3d16bdef9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.433367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.434007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.434290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.434588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.435325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:11.435633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.437047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.458834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 541/1070] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:11.464290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.475335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f261b8-c697-4f4c-91e6-d1d9360fcd9e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.492460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.513706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.514251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.514587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.514865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.515527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:11.515833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.517212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.526143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 530/1071] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:11.531944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.562944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.573095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158fd0-e228-4598-8ed0-bbb7ed40a882 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.609677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.610302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.610589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.610881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.620984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.622411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:11.637708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:11.638730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:11.639648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:11.639648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:11.639648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:11.639648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 542/1072] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:11.643840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5927-3fa0-4eda-9f77-15ad3cfb2f5e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.644473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.680835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.681469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.681749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.682021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] PATH_INFO: `/v3/users/4c38d29b691749a2b9288f7abfbc8a32` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.683171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] RBAC: Authorizing `identity:get_user(user_id=4c38d29b691749a2b9288f7abfbc8a32)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.684860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.690801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 531/1073] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/users/4c38d29b691749a2b9288f7abfbc8a32 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:11.692395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.729834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.751941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b35c5-39c4-468f-a5c8-709573835e98 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.785874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.786399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.786708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.786982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.787618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:11.787916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.789076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.789818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.799171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e7169-af1e-4272-8ba5-47fcb7d9d8fa None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.807236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 543/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:11.808612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.836491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.837117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.837438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.837887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.838854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.840272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.842074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 532/1075] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:11.847947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.913945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde118e-19b0-415a-8c2a-d33c7af78c27 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.950698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.951329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.951659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.951927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.957784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbedc2f-9a4e-479b-85c6-2b9edab620c0 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:11.958602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.960597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:11.962750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-dc703b55-032f-404a-a4e4-496a9f81f65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:13:11.973496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:11.974410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:11.975347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 544/1076] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:11.976039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8f84-ae28-4211-97a1-aaa61a0bd540 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.976152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8f84-ae28-4211-97a1-aaa61a0bd540 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.976462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8f84-ae28-4211-97a1-aaa61a0bd540 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.977739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 545/1077] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:11.980364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8f84-ae28-4211-97a1-aaa61a0bd540 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:11.995096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:11.995753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:11.996030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:11.996303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec/users/4c38d29b691749a2b9288f7abfbc8a32/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:11.998195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] RBAC: Authorizing `identity:create_grant(project_id=d382cc801056437190cb1facf13206ec, user_id=4c38d29b691749a2b9288f7abfbc8a32, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:11.999667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3d66f-ebd2-47b6-8d3d-6124217c5159 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:12.014533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 533/1078] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:13:11 2022] PUT /identity/v3/projects/d382cc801056437190cb1facf13206ec/users/4c38d29b691749a2b9288f7abfbc8a32/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:13:12.015715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:12.015999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:12.016269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:12.037312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:12.039122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:12.055806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:12.099665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8f84-ae28-4211-97a1-aaa61a0bd540 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:12.123935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 534/1079] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:12.137827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:12.138551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:12.138764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:12.139035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:12.139736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:12.140047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:12.141489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:12.158336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 546/1080] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:12.164407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:12.267487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad6b3-6473-411f-b199-786577eeee13 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:12.301977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:12.302560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:12.302919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:12.303196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/b6c4680466f44ff0b06c88562bb9d942` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:12.305898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=c3d216824c7946abb79dd7c65cfd1ac3, role_id=b6c4680466f44ff0b06c88562bb9d942)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:12.307438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:12.326594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 535/1081] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:13:12 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/c3d216824c7946abb79dd7c65cfd1ac3/roles/b6c4680466f44ff0b06c88562bb9d942 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:13:12.394610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:12.459633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:12.504792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3dd59-1992-4a9d-80fd-9af6eb87531c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:12.538312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:12.538946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:12.539224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:12.539496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:12.605919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:12.607297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:12.662791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:12.706626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 547/1082] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:12.712838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:12.725313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:12.817000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7f02-aca2-4347-9136-90d2d611273e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:12.849498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:12.850131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:12.850410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:12.851244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:12.861536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:12.862940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-f7dcb149-bec4-4eb1-be45-6701fd3b94ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:12.877373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:12.878344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:12.879623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:12.879623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:12.879623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:12.882876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 536/1083] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:12.884390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:12.982998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4269e-68af-4f40-b625-097918cb72cb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:13.019484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:13.020086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:13.020362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:13.020630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:13.021257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:13.021558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:13.023001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2ddf-e117-47d4-b27d-2b42f7555319 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:13.042590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 548/1084] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:13.941973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c535c8-e0ef-4deb-bab6-e6cc7e5de666 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:13.942528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c535c8-e0ef-4deb-bab6-e6cc7e5de666 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:13.942643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c535c8-e0ef-4deb-bab6-e6cc7e5de666 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:13.944002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 537/1085] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:13.949164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1bad7-4545-47f6-8c5c-8ed7b71dcc38 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:13.949586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1bad7-4545-47f6-8c5c-8ed7b71dcc38 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:13.949710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1bad7-4545-47f6-8c5c-8ed7b71dcc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:13.967971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-daf1bad7-4545-47f6-8c5c-8ed7b71dcc38 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:13.969125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-daf1bad7-4545-47f6-8c5c-8ed7b71dcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:13.982446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.035242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 549/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:14.231551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec4f3-22c5-4a72-be9a-4f958920ee2b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.231762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec4f3-22c5-4a72-be9a-4f958920ee2b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.232030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec4f3-22c5-4a72-be9a-4f958920ee2b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.233377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 538/1087] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:14.238351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.238665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.238940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.256223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:14.257956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:14.299940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec4f3-22c5-4a72-be9a-4f958920ee2b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.323111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 550/1088] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:14.361042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.399658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec4f3-22c5-4a72-be9a-4f958920ee2b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.431994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.432620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.432900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.433169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.442943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:14.448035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:14.448993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:14.449842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 539/1089] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:14.455256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.530872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.551625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb1b9-3e3e-41da-b287-3e96d5d37f7e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.585770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.586644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.586926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.587198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.587853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:14.588153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:14.589491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:14.592281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.597733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 551/1090] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:14.603562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.690323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748ca7a-fa6e-4080-a57b-6f166d05f00e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.701928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505e7c2-d352-4cca-8497-cc58efb6c863 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.713065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.724878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.725495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.725764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.726034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.735267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.735884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.735986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:14.736166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.736440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] PATH_INFO: `/v3/users/4c38d29b691749a2b9288f7abfbc8a32` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.737558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] RBAC: Authorizing `identity:get_user(user_id=4c38d29b691749a2b9288f7abfbc8a32)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:14.739004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:14.740567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 552/1091] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/users/4c38d29b691749a2b9288f7abfbc8a32 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:14.746245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:14.747414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:14.748281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 540/1092] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:14.748995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.749065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.760469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.845813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5db5d3-eeab-4107-8906-2985818cb731 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.848133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b276-9be3-4559-be95-9880b7328d0e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:14.878852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.879455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.879735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.880008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.881408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:14.882637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:14.882922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:14.883191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:14.883831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:14.884134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:14.885486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:14.893207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 541/1093] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:14.898791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:14.942428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.946268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:14.947737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:14.957054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:14.996903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ca1f2-0c9d-4bda-a00c-87e08500303e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.029544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.030160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.030435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.030739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.041881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.043391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.043648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 553/1094] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:15.049495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:15.057694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:15.058687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:15.059580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:15.059580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:15.059580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:15.059580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 542/1095] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:13:15.064499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.146946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72bb23-5e13-43d9-9ee3-2591daf85071 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.154323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.156478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.162264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebab49-af29-4586-913e-a729ab34af09 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.184507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.185138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.185419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.185690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.186836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.188249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.190050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 554/1096] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:15.195733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.197564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.198167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.198449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.198751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.199390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:15.199692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.201033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.213444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 543/1097] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:15.218979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.293964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511767df-773e-4a38-b9d3-73b5e449ab9a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.314698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596036ce-b1a8-4406-b21d-89c7814fe148 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.329460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.330056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.330334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.330652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.331346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=d382cc801056437190cb1facf13206ec, user.id=4c38d29b691749a2b9288f7abfbc8a32) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:15.331649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.333061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.339588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 555/1098] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/role_assignments?user.id=4c38d29b691749a2b9288f7abfbc8a32&scope.project.id=d382cc801056437190cb1facf13206ec&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:13:15.348617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.349276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.349559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.349831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.358896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.360382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:13:15.373238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:15.374249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:15.375250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 544/1099] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:15.380418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.425595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.486096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06047f97-1036-4044-a26d-6bee3ced4670 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.519654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.520255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.520533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.520812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.521527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:15.521828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.523789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.541011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 556/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:15.546903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.565642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.644919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39543de9-e449-4a6f-b25e-26a12dd9a45d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.677769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.678321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.678626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.678923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.743004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.744436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:15.761116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.841275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 545/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:15.847052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:15.939977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:15.943810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3be87-4346-48a7-a49a-75dd067de601 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:15.977331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:15.977934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:15.978219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:15.978492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:15.988157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:15.989571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:16.003518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:16.004453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:13:16.005351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:16.005351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:13:16.005351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:16.005351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 557/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:16.010949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:16.106680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27649-56b5-4239-88ae-98469e8dffe9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:16.122902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:16.141136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:16.141732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:16.142012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:16.142287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:16.142948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:16.143254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:16.144615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:16.155656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 546/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:16.161343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:16.258380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8f55-b6ff-4fb1-89c6-87950c67b148 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:16.290138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:16.290792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:16.291075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:16.291351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:16.297794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:16.299254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:13:16.311344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:16.312406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:13:16.313511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:16.314714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 558/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:16.318319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:16.415851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4213b78-9312-409b-a9fe-78b7a7ce853b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:16.450372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:16.451002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:16.451283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:16.451557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:16.452242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:16.452545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:16.453961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb6bcd-499d-49eb-abb3-1700e1b73b87 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:16.465971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 547/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:16.472082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:16.484996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:16.568970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520553-e1b7-4b22-b073-6764cbf37e44 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:16.601110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:16.601716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:16.601997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:16.602272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:16.603027 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] RBAC: Adding query filter params (role.id=b6c4680466f44ff0b06c88562bb9d942, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=c3d216824c7946abb79dd7c65cfd1ac3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:16.603334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:16.604742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c259b-9801-483a-a109-752b14d3bf12 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:16.610388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 559/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:16 2022] GET /identity/v3/role_assignments?user.id=c3d216824c7946abb79dd7c65cfd1ac3&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=b6c4680466f44ff0b06c88562bb9d942 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:17.271263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450749-a61e-45e6-bd3d-d427a384b9fb None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:17.271765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450749-a61e-45e6-bd3d-d427a384b9fb None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:17.271869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da450749-a61e-45e6-bd3d-d427a384b9fb None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:17.273737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 548/1107] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:17.279059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:17.279473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:17.279602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:17.297457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:17.298670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:17.366161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 560/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:17.631390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da450749-a61e-45e6-bd3d-d427a384b9fb None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:17.665954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:17.727905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da450749-a61e-45e6-bd3d-d427a384b9fb None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:17.760454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:17.761059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:17.761336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:17.761602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:17.762707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:17.764143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4422f5-eec7-47d6-bc11-b4ed4e8b6ccf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:17.765653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 549/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:17.771370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:17.774388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:17.864052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b4e5e-26df-4f93-a708-06497d31d13d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:17.896825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:17.897357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:17.897663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:17.897932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:17.898592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:17.899996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ad56-86f4-4418-89b9-ebf133761d53 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:17.920178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 561/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:13:17 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:13:19.827650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b8e-02fa-4f16-aef3-f821629be6f8 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:19.828175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b8e-02fa-4f16-aef3-f821629be6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:19.828175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b8e-02fa-4f16-aef3-f821629be6f8 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:19.829537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 550/1111] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:19.834762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:19.835698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:19.835828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:19.854138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:19.855350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:19.915420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:19.926811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 562/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:20.197549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3b8e-02fa-4f16-aef3-f821629be6f8 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:20.294957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3b8e-02fa-4f16-aef3-f821629be6f8 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:20.297183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:20.327627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:20.328237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:20.328517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:20.328790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] PATH_INFO: `/v3/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:20.330156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] RBAC: Authorizing `identity:get_role(role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:20.331549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:20.332851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 551/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:20 2022] GET /identity/v3/roles/072aae4a92604daca4ad778a1b442950 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:20.339457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:20.433005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0187b0-7df5-42f9-a72d-803571bdc2d2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:20.466024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:20.466662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:20.466948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:20.467226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] PATH_INFO: `/v3/users/a677e81f3a734611b01d956e6b2f82f8` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:20.479612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] RBAC: Authorizing `identity:get_user(user_id=a677e81f3a734611b01d956e6b2f82f8)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:20.481039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:20.482674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 563/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:20 2022] GET /identity/v3/users/a677e81f3a734611b01d956e6b2f82f8 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:20.488382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:20.589712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63441b-2df3-4de6-970a-c93753ac115f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:20.621567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:20.622158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:20.622433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:20.622734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:20.660868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:20.686798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:20.688161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:20.782235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 552/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:20.788178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:20.835834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:20.883718 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b67c-c8ff-4389-860c-c927ae0ab000 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:20.915770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:20.916377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:20.916651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:20.916916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:20.917997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:20.919454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dd56b-ecf1-4ee2-84b9-a0be7deaf59a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:20.921024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 564/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:20 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:20.926963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:20.993193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:21.021245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eeff3-83b3-48d8-b911-204a67a5b6cd None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:21.054993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:21.055587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:21.055865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:21.056135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:21.056849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=d382cc801056437190cb1facf13206ec, user.id=a677e81f3a734611b01d956e6b2f82f8) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:21.057162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:21.058588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265689a-a718-4c33-bc1b-4ce93eb43a54 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:21.063715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 553/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:20 2022] GET /identity/v3/role_assignments?user.id=a677e81f3a734611b01d956e6b2f82f8&scope.project.id=d382cc801056437190cb1facf13206ec&role.id=072aae4a92604daca4ad778a1b442950 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:22.922589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e3eb-5fef-46a3-98f0-f03caeb93aa1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:22.923120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e3eb-5fef-46a3-98f0-f03caeb93aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:22.923228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e3eb-5fef-46a3-98f0-f03caeb93aa1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:22.924490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 565/1118] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:22.929998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:22.930439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:22.930531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:22.948397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:22.949560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:23.012596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 554/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:23.279575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e3eb-5fef-46a3-98f0-f03caeb93aa1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:23.377858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e3eb-5fef-46a3-98f0-f03caeb93aa1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:23.393288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:23.409984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:23.410624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:23.410902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:23.411174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] PATH_INFO: `/v3/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:23.412531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] RBAC: Authorizing `identity:get_role(role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:23.414361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:23.415862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 566/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:23 2022] GET /identity/v3/roles/072aae4a92604daca4ad778a1b442950 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:23.421515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:23.484398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:23.517796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc15b-627b-422f-a711-38e9b082fccb None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:23.550190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:23.550828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:23.551115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:23.551392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] PATH_INFO: `/v3/users/a677e81f3a734611b01d956e6b2f82f8` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:23.552494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] RBAC: Authorizing `identity:get_user(user_id=a677e81f3a734611b01d956e6b2f82f8)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:23.553910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:23.556094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 555/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:23 2022] GET /identity/v3/users/a677e81f3a734611b01d956e6b2f82f8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:23.561630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:23.655505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8e473-6554-4a33-aed4-31db3e43d535 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:23.687939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:23.688564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:23.688847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:23.689125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:23.690239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:23.691688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f80a-be39-4949-9918-2e97b5ff21ee None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:23.693302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 567/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:23 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:23.699405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:23.795696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91b-b8a5-4a61-9c40-886507bddd75 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:23.827299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:23.827946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:23.828226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:23.828499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec/users/a677e81f3a734611b01d956e6b2f82f8/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:23.830634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=d382cc801056437190cb1facf13206ec, user_id=a677e81f3a734611b01d956e6b2f82f8, role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:23.832050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee869-dddd-417a-99be-803f000e2fbb None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:23.834172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:23.845276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 556/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:13:23 2022] PUT /identity/v3/projects/d382cc801056437190cb1facf13206ec/users/a677e81f3a734611b01d956e6b2f82f8/roles/072aae4a92604daca4ad778a1b442950 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:13:25.705773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af41b5-0e90-4e57-bdec-4f2bb2f1f0a9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:25.706294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af41b5-0e90-4e57-bdec-4f2bb2f1f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:25.706294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af41b5-0e90-4e57-bdec-4f2bb2f1f0a9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:25.707676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 568/1124] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:25.713007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:25.713445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:25.713560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:25.731589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:25.732760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:25.796210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 557/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:26.066169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af41b5-0e90-4e57-bdec-4f2bb2f1f0a9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:26.119575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:26.167345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af41b5-0e90-4e57-bdec-4f2bb2f1f0a9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:26.200615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:26.201240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:26.201521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:26.201799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] PATH_INFO: `/v3/roles/072aae4a92604daca4ad778a1b442950` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:26.203216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] RBAC: Authorizing `identity:get_role(role_id=072aae4a92604daca4ad778a1b442950)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:26.204569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:26.205879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 569/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:26 2022] GET /identity/v3/roles/072aae4a92604daca4ad778a1b442950 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:26.212538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:26.313481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287f1a3-3c9e-4fc1-8169-942b8961b44f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:26.337314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:26.348451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:26.349075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:26.349354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:26.349628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] PATH_INFO: `/v3/users/a677e81f3a734611b01d956e6b2f82f8` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:26.350758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] RBAC: Authorizing `identity:get_user(user_id=a677e81f3a734611b01d956e6b2f82f8)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:26.352328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:26.354066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 558/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:26 2022] GET /identity/v3/users/a677e81f3a734611b01d956e6b2f82f8 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:26.360094 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:26.455921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf4dc-b94c-45c0-aa1d-e8757435480b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:26.475138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:26.489011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:26.489604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:26.489883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:26.490156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:26.553594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:26.555593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:26.652516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 570/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:26.658535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:26.755115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc183-a99d-4500-9b46-894cef6dc17d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:26.789735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:26.790369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:26.790674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:26.790952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] PATH_INFO: `/v3/projects/d382cc801056437190cb1facf13206ec` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:26.792067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] RBAC: Authorizing `identity:get_project(project_id=d382cc801056437190cb1facf13206ec)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:26.793500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae33e-a4d5-4c45-a3e7-b3dc624c8f8b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:26.795166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 559/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:26 2022] GET /identity/v3/projects/d382cc801056437190cb1facf13206ec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:26.801404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:26.832527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:26.910892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050240-b6d9-4500-b33d-03c259db4fd9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:26.945163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:26.945765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:26.946047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:26.946322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:26.947084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] RBAC: Adding query filter params (role.id=072aae4a92604daca4ad778a1b442950, scope.project.id=d382cc801056437190cb1facf13206ec, user.id=a677e81f3a734611b01d956e6b2f82f8) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:26.947391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:26.948810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866500fb-f78a-49fb-93d5-54041e924c26 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:26.954463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 571/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:26 2022] GET /identity/v3/role_assignments?user.id=a677e81f3a734611b01d956e6b2f82f8&scope.project.id=d382cc801056437190cb1facf13206ec&role.id=072aae4a92604daca4ad778a1b442950 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:28.876407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd46fc-ee01-4420-81a0-de93be5a9cd6 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:28.876992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd46fc-ee01-4420-81a0-de93be5a9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:28.876992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd46fc-ee01-4420-81a0-de93be5a9cd6 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:28.878284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 560/1131] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:28.883421 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:28.883845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:28.883984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:28.901896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:28.903116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:28.967309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 572/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:29.235837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd46fc-ee01-4420-81a0-de93be5a9cd6 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:29.294389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:29.335429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd46fc-ee01-4420-81a0-de93be5a9cd6 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:29.368818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:29.369427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:29.369707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:29.369980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:29.371098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:29.372515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03038-751a-4364-88d9-53f0d3272c8b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:29.374053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 561/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:29.380032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:29.394377 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:29.474404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b415f-8900-4d13-b1eb-447fefc14e2a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:29.506770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:29.507381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:29.507657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:29.507926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:29.508566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:29.509965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422dbe1-54f7-4259-b71b-a3a761659cf3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:29.535237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 573/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:13:29 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:13:31.450710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb94b0-cf71-4f8a-9dc7-ca7fe912d258 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:31.451214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb94b0-cf71-4f8a-9dc7-ca7fe912d258 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:31.451214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb94b0-cf71-4f8a-9dc7-ca7fe912d258 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:31.452525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 562/1135] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:31.457913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:31.458331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:31.458471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:31.476880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:31.478057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:31.534653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:31.542622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 574/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:31.812222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb94b0-cf71-4f8a-9dc7-ca7fe912d258 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:31.910083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb94b0-cf71-4f8a-9dc7-ca7fe912d258 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:31.935625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:31.943402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:31.944020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:31.944301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:31.945219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:31.946320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:31.947766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5374d6a-a3ad-40d4-9221-3ad540656966 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:31.949318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 563/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:13:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:31.955137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:32.049353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b118c-ccca-406e-b6f2-db13a90441ba None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:32.082279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:32.082842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:32.083128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:32.083404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:32.084051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:32.085512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce104b-b443-46ec-be34-418e8e012e56 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:32.105813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 575/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:13:31 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:34.023946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42d763-0ea8-4359-ba52-8684ed65d3e9 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.024505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42d763-0ea8-4359-ba52-8684ed65d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.024505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42d763-0ea8-4359-ba52-8684ed65d3e9 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:34.025845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 564/1139] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:34.031267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.031694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.031812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:34.050353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:34.051537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:34.096833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:34.117351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 576/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:34.384325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42d763-0ea8-4359-ba52-8684ed65d3e9 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:34.482496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42d763-0ea8-4359-ba52-8684ed65d3e9 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:34.514925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:34.515535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.515814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.516088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:34.526268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:34.530925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:34.532102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:34.533203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 565/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:34.538034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:34.635515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014484-b84f-40de-a1f8-a7eab780ed8c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:34.667956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:34.668547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.668827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.669102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:34.669757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:34.670058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:34.671442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:34.679184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 577/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:34.684973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:34.739973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:34.782061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079985-1797-43d9-a1a0-7ebad1203b3e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:34.814309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:34.814951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.815233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.815505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] PATH_INFO: `/v3/users/b78d094a92974adc8144596fd5c34c0f` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:34.828524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] RBAC: Authorizing `identity:get_user(user_id=b78d094a92974adc8144596fd5c34c0f)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:34.829955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:34.831536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 566/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:34 2022] GET /identity/v3/users/b78d094a92974adc8144596fd5c34c0f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:34.837576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:34.881166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:34.932796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d220894-acd9-4542-84e2-42f522f9b687 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:34.964480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:34.965063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:34.965338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:34.965606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:35.028382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:35.029789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:35.071178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:35.123298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 578/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:13:35.129184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:35.226195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3125dc-625d-4f4b-b97b-15c56242937e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:35.239338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:35.259350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:35.259969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:35.260251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:35.260524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] PATH_INFO: `/v3/projects/3edc053146b542dfb8eaa4f84ab77fac` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:35.261620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] RBAC: Authorizing `identity:get_project(project_id=3edc053146b542dfb8eaa4f84ab77fac)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:35.263164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50262d4b-511c-4292-9cb4-dabe698e70d0 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:35.264772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 567/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:35 2022] GET /identity/v3/projects/3edc053146b542dfb8eaa4f84ab77fac => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:35.270949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:35.364201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c43-3320-4996-9dfa-09942d52a429 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:35.396075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:35.396656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:35.396934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:35.397207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:35.397946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=3edc053146b542dfb8eaa4f84ab77fac, user.id=b78d094a92974adc8144596fd5c34c0f) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:35.398250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:35.399671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917a0b-bfb1-4814-a645-32abcf7c1330 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:35.404716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 579/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:35 2022] GET /identity/v3/role_assignments?user.id=b78d094a92974adc8144596fd5c34c0f&scope.project.id=3edc053146b542dfb8eaa4f84ab77fac&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:37.243675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9ea3-79ed-4358-819c-17fe910aab91 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:37.244119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9ea3-79ed-4358-819c-17fe910aab91 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:37.244233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9ea3-79ed-4358-819c-17fe910aab91 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:37.245583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 568/1147] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:37.250703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:37.251116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:37.251262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:37.268929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:37.270100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:37.272044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:37.335702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 580/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:37.598629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9ea3-79ed-4358-819c-17fe910aab91 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:37.695685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9ea3-79ed-4358-819c-17fe910aab91 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:37.728312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:37.728920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:37.729203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:37.729482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:37.739216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:37.743988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:37.745068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:37.746051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 569/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:37.751058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:37.844087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c03652-4dff-4f92-8aef-afd3222a0d13 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:37.875863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:37.876391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:37.876665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:37.876934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:37.877580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:37.877876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:37.879237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:37.884545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:37.887905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 581/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:37.893400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:37.936388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:37.991929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61b1b2-7ae6-48e3-9bdc-b1b8d4d68f7c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:38.024199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:38.024811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:38.025086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:38.025355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] PATH_INFO: `/v3/users/b78d094a92974adc8144596fd5c34c0f` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:38.026441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] RBAC: Authorizing `identity:get_user(user_id=b78d094a92974adc8144596fd5c34c0f)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:38.027889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:38.029438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 570/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:37 2022] GET /identity/v3/users/b78d094a92974adc8144596fd5c34c0f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:38.035210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:38.129627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa88c05-6db9-4587-b78b-7528f62fe216 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:38.161943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:38.162586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:38.162877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:38.163651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] PATH_INFO: `/v3/projects/3edc053146b542dfb8eaa4f84ab77fac` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:38.164759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] RBAC: Authorizing `identity:get_project(project_id=3edc053146b542dfb8eaa4f84ab77fac)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:38.166164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216f8a-8e30-4e18-9292-3c4266925390 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:38.167802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 582/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:38 2022] GET /identity/v3/projects/3edc053146b542dfb8eaa4f84ab77fac => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:38.173613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:38.270009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d918b-769c-4dc3-b39c-7b8be7539e44 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:38.279864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:38.303487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:38.304731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:38.305010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:38.305285 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] PATH_INFO: `/v3/projects/3edc053146b542dfb8eaa4f84ab77fac/users/b78d094a92974adc8144596fd5c34c0f/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:38.307183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] RBAC: Authorizing `identity:create_grant(project_id=3edc053146b542dfb8eaa4f84ab77fac, user_id=b78d094a92974adc8144596fd5c34c0f, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:38.308596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7487e-1043-48ce-a3a3-03167f95d4da None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:38.321160 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 571/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:13:38 2022] PUT /identity/v3/projects/3edc053146b542dfb8eaa4f84ab77fac/users/b78d094a92974adc8144596fd5c34c0f/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:13:40.191966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3fc3-13c7-4199-abb7-913b7264291f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:40.192427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3fc3-13c7-4199-abb7-913b7264291f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:40.192522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3fc3-13c7-4199-abb7-913b7264291f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:40.193827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 583/1154] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:40.199010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:40.199430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:40.199568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:40.217956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:40.219171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:40.283258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 572/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:40.548850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3fc3-13c7-4199-abb7-913b7264291f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:40.614345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:40.647530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3fc3-13c7-4199-abb7-913b7264291f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:40.679239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:40.679846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:40.680123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:40.680394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:40.689924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:40.695131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:40.696196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:40.697366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 584/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:40.702172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:40.794406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:40.797354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a389ea-1782-4b3c-ace7-9fdec20bc9ff None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:40.833056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:40.833593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:40.833873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:40.834145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:40.834824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:40.835125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:40.836478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:40.844363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 573/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:40.850022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:40.943758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992280-e361-4e7d-87d1-0b85fc0f4ed3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:40.969116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:40.977053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:40.977659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:40.977936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:40.978205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] PATH_INFO: `/v3/users/b78d094a92974adc8144596fd5c34c0f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:40.979337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] RBAC: Authorizing `identity:get_user(user_id=b78d094a92974adc8144596fd5c34c0f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:40.980739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:40.982267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 585/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:40 2022] GET /identity/v3/users/b78d094a92974adc8144596fd5c34c0f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:40.988151 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:41.084559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357356-b093-4880-b202-3cc050f98af6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:41.115938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:41.117019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:41.117294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:41.117564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:41.145737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:41.183029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:41.184476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:41.277096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 574/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:41.283008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:41.379882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d932be-71f0-4cba-ab54-c6a400c8e5bc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:41.411346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:41.411952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:41.412227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:41.412500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] PATH_INFO: `/v3/projects/3edc053146b542dfb8eaa4f84ab77fac` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:41.414109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] RBAC: Authorizing `identity:get_project(project_id=3edc053146b542dfb8eaa4f84ab77fac)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:41.415534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf58906-63bb-4f0d-a480-f0a2e8310417 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:41.417208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 586/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:41 2022] GET /identity/v3/projects/3edc053146b542dfb8eaa4f84ab77fac => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:41.423181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:41.481220 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:41.518977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8a1f-baac-44f9-b220-5758e9a9431a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:41.551491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:41.552073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:41.552349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:41.552617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:41.553325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=3edc053146b542dfb8eaa4f84ab77fac, user.id=b78d094a92974adc8144596fd5c34c0f) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:41.553625 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:41.555703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91182ed6-9816-47d9-9ac3-0e351d3da42a None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:41.561457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 575/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:41 2022] GET /identity/v3/role_assignments?user.id=b78d094a92974adc8144596fd5c34c0f&scope.project.id=3edc053146b542dfb8eaa4f84ab77fac&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:43.446655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c615-a513-49c1-b3a9-b26172e6dfa9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:43.447155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c615-a513-49c1-b3a9-b26172e6dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:43.447155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c615-a513-49c1-b3a9-b26172e6dfa9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:43.448451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 587/1162] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:43.453701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:43.454073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:43.454252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:43.472586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:43.473765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:43.536752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 576/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:43.801293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943c615-a513-49c1-b3a9-b26172e6dfa9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:43.862347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:43.900535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943c615-a513-49c1-b3a9-b26172e6dfa9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:43.932744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:43.933334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:43.933612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:43.933884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:44.005629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:44.007687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:44.063349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:44.103035 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 588/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:44.109017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:44.163677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:44.205126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9e4f-d009-49ff-baa2-62f16466bfd4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:44.237760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:44.238368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:44.238671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:44.238941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:44.245819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:44.247272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-c9b03a30-65c4-49e6-b384-e17eb2b3e9d3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:44.259219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:44.260246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:13:44.261192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 577/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:13:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:44.266357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:44.360637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f45239-ddef-49e7-b04b-4934b9d8bd06 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:44.392467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:44.393051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:44.393327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:44.393595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:44.394216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:44.394511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:44.395868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02386c62-fd33-4ea4-b1fb-6ea0a3269c2c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:44.403192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 589/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 19 02:13:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:46.251796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f312c-9e93-421a-8d61-307115fff40e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:46.252263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f312c-9e93-421a-8d61-307115fff40e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:46.252373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f312c-9e93-421a-8d61-307115fff40e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:46.253692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 578/1167] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:46.259255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf1fb-7497-45c5-8cb1-368b0ad1bb11 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:46.259675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf1fb-7497-45c5-8cb1-368b0ad1bb11 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:46.259808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf1fb-7497-45c5-8cb1-368b0ad1bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:46.277302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-caedf1fb-7497-45c5-8cb1-368b0ad1bb11 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:46.278471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-caedf1fb-7497-45c5-8cb1-368b0ad1bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:46.300197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:46.343271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 590/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:46.618093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f312c-9e93-421a-8d61-307115fff40e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:46.718456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f312c-9e93-421a-8d61-307115fff40e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:46.735364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:46.753772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:46.754372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:46.754686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:46.754966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:46.755619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:46.757010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fd951-753f-4ab6-ba7b-2e7bda522870 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:46.772609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 579/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Fri Aug 19 02:13:46 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:48.678296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016b61-e5d7-49d0-b45a-521af68dcd37 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:48.679396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016b61-e5d7-49d0-b45a-521af68dcd37 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:48.679490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016b61-e5d7-49d0-b45a-521af68dcd37 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:48.680769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 591/1170] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:48.686117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:48.686539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:48.686688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:48.704006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:48.705163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:48.767938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 580/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:49.033335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016b61-e5d7-49d0-b45a-521af68dcd37 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:49.130091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016b61-e5d7-49d0-b45a-521af68dcd37 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:49.163019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:49.164164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:49.164444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:49.164716 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] PATH_INFO: `/v3/domains/6a4c74089a2c4d9f9b1b7e21bf3fd361` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:49.174623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a4c74089a2c4d9f9b1b7e21bf3fd361)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:49.176038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3fb3b-ae08-4d87-9f53-241f9d28f4be None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:49.177606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 592/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Aug 19 02:13:49 2022] GET /identity/v3/domains/6a4c74089a2c4d9f9b1b7e21bf3fd361 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:49.183425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:49.278619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6c168-6bdf-49ad-8b74-2d4a75b5bec7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:49.285744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:49.312254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:49.312850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:49.313127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:49.313398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:49.314028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:49.315472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac8c8-ac3a-4460-b3d8-0928445d91e6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:49.340858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 581/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:13:49 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:51.244667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484efb6-ff10-489e-b137-2e62b2d7d1c8 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:51.245121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484efb6-ff10-489e-b137-2e62b2d7d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:51.245225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484efb6-ff10-489e-b137-2e62b2d7d1c8 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:51.246535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 593/1174] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:51.251816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:51.252240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:51.252370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:51.270395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:51.271593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:51.334516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 582/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:13:51.601784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484efb6-ff10-489e-b137-2e62b2d7d1c8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:51.621302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:51.700555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484efb6-ff10-489e-b137-2e62b2d7d1c8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:51.732570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:51.733182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:51.733465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:51.733740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] PATH_INFO: `/v3/domains/6a4c74089a2c4d9f9b1b7e21bf3fd361` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:51.734871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a4c74089a2c4d9f9b1b7e21bf3fd361)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:51.736281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b148435-4b77-419a-98fe-7e699a9ad6f0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:51.737804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 594/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Aug 19 02:13:51 2022] GET /identity/v3/domains/6a4c74089a2c4d9f9b1b7e21bf3fd361 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:51.743893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:51.826822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:51.839947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8426d1-2656-4133-b738-18eb925b5127 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:51.872387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:51.872929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:51.873209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:51.873481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:51.874113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:51.875552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ad52-ff28-4cc5-b230-73088e4aa43f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:51.895885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 583/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:13:51 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:13:53.814747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d70c-4811-43de-8087-6b1bc9e0f3dc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:53.815270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d70c-4811-43de-8087-6b1bc9e0f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:53.815375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d70c-4811-43de-8087-6b1bc9e0f3dc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:53.816662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 595/1178] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:53.822364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:53.822784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:53.822961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:53.841921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:53.843128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:53.906766 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 584/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:54.174925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d70c-4811-43de-8087-6b1bc9e0f3dc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:54.259935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:54.273483 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d70c-4811-43de-8087-6b1bc9e0f3dc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:54.306091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:54.306731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:54.307012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:54.307282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:54.317032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:54.321727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:54.322842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:54.323980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 596/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:54.328857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:54.400715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:54.425279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a6480-c74b-4c7b-9b20-516b9bb18853 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:54.457516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:54.458109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:54.458388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:54.458689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:54.459343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:54.459642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:54.461562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:54.469557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 585/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:54.475225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:54.573773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de651-953d-4fb1-8beb-c2e3f12e01e5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:54.606324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:54.606963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:54.607241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:54.607515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] PATH_INFO: `/v3/users/a489a64b0cde498d9dfdc75526792da9` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:54.619762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] RBAC: Authorizing `identity:get_user(user_id=a489a64b0cde498d9dfdc75526792da9)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:54.621174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:54.622746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 597/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:54 2022] GET /identity/v3/users/a489a64b0cde498d9dfdc75526792da9 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:54.628736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:54.725087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b761d-aeb8-406c-ac8e-e1f112ffa801 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:54.757762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:54.758346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:54.758646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:54.758919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:54.762149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:54.823596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:54.825023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:54.917558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 586/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:13:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:13:54.923282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:54.926979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:55.019685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de77f0f-c061-482c-bbc1-2a157598ae90 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:55.052663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:55.053274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:55.053551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:55.053853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] PATH_INFO: `/v3/projects/fa844cca27164026934da226ab06a70c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:55.054969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] RBAC: Authorizing `identity:get_project(project_id=fa844cca27164026934da226ab06a70c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:55.056398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1e202-f8e8-462f-b9c2-c9b06acdec87 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:55.057982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 598/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:54 2022] GET /identity/v3/projects/fa844cca27164026934da226ab06a70c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:55.063986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:55.097383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:55.160510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149e98-e2e6-432b-a337-a7316b83232c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:55.192588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:55.193184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:55.193465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:55.193739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:55.195009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=fa844cca27164026934da226ab06a70c, user.id=a489a64b0cde498d9dfdc75526792da9) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:55.195317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:55.196734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c92ba-81f3-4aed-856f-76bf26bb20d5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:55.201852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 587/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:13:55 2022] GET /identity/v3/role_assignments?user.id=a489a64b0cde498d9dfdc75526792da9&scope.project.id=fa844cca27164026934da226ab06a70c&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:57.040128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8456-7cf3-4fd6-b29b-c7e21d2d4221 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.040655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8456-7cf3-4fd6-b29b-c7e21d2d4221 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.040655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8456-7cf3-4fd6-b29b-c7e21d2d4221 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.041985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 599/1186] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:57.047200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.047603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.047750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.066344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:13:57.067589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:13:57.130970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 588/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:13:57.398657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c8456-7cf3-4fd6-b29b-c7e21d2d4221 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:57.466975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:57.495902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c8456-7cf3-4fd6-b29b-c7e21d2d4221 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:57.528729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:57.529351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.529636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.529910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.539696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:13:57.544331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:13:57.545486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:13:57.546811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 600/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:13:57.551348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:57.579952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:57.645828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e898b9-dc76-4bdb-bc52-06af953b4b53 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:57.678039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:57.678795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.678917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.679155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.679804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:13:57.680106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:57.681460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:57.689128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 589/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:57.695299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:57.791469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4ff32-8458-4dd0-b007-da3743c96675 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:57.818762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:57.823822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:57.824432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.824707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.824976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] PATH_INFO: `/v3/users/a489a64b0cde498d9dfdc75526792da9` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.826067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] RBAC: Authorizing `identity:get_user(user_id=a489a64b0cde498d9dfdc75526792da9)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:57.827535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:57.829064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 601/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:13:57 2022] GET /identity/v3/users/a489a64b0cde498d9dfdc75526792da9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:57.834656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:57.922692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:13:57.931206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d591fe0-781d-47f1-bb5d-873c67fa33b9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:57.963254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:57.963865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:57.964144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:57.964416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] PATH_INFO: `/v3/projects/fa844cca27164026934da226ab06a70c` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:57.965511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] RBAC: Authorizing `identity:get_project(project_id=fa844cca27164026934da226ab06a70c)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:57.966938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d52f2-dfcc-4c30-acca-9775cfaff501 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:57.968532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 590/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:13:57 2022] GET /identity/v3/projects/fa844cca27164026934da226ab06a70c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:13:57.974263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:13:58.070463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818fb5-b3ee-448a-adc3-bfee0314124a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:13:58.104351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:13:58.104999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:58.105283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:58.105561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] PATH_INFO: `/v3/projects/fa844cca27164026934da226ab06a70c/users/a489a64b0cde498d9dfdc75526792da9/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:58.107489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] RBAC: Authorizing `identity:create_grant(project_id=fa844cca27164026934da226ab06a70c, user_id=a489a64b0cde498d9dfdc75526792da9, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:13:58.108913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844d11f-0b09-44f0-a8ce-efda8820c63d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:13:58.121116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 602/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:13:57 2022] PUT /identity/v3/projects/fa844cca27164026934da226ab06a70c/users/a489a64b0cde498d9dfdc75526792da9/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:13:59.973115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b336b-1aa0-4d7c-84b1-60d8fba87385 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:59.973664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b336b-1aa0-4d7c-84b1-60d8fba87385 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:59.973664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b336b-1aa0-4d7c-84b1-60d8fba87385 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:59.975049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 591/1193] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:13:59.980250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:13:59.980688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:13:59.980813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:13:59.998873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:14:00.000053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:14:00.052971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:00.065088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 603/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:13:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:14:00.336404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b336b-1aa0-4d7c-84b1-60d8fba87385 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:00.434343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b336b-1aa0-4d7c-84b1-60d8fba87385 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:00.466201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:00.466836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:00.467117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:00.467389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:00.477537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:14:00.482126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:14:00.483464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:14:00.484581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 592/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:14:00.489024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:00.584531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc14f-476d-4318-8e76-af4481f7911c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:00.617970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:00.618511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:00.618823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:00.619100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:00.619761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:14:00.620065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:00.621415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:00.629255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 604/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:00.635023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:00.656526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:00.732149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782258-6da6-4283-9574-c931df1f4c79 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:00.763799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:00.764402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:00.764683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:00.764957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] PATH_INFO: `/v3/users/a489a64b0cde498d9dfdc75526792da9` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:00.766057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] RBAC: Authorizing `identity:get_user(user_id=a489a64b0cde498d9dfdc75526792da9)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:00.767496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:00.769028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 593/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 19 02:14:00 2022] GET /identity/v3/users/a489a64b0cde498d9dfdc75526792da9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:00.775175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:00.825678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:00.872480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cf17-6767-4c15-b4e7-cc97075b3697 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:00.904352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:00.904945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:00.905226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:00.905502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:00.969605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:00.971064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:01.018635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:01.064506 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 605/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:14:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:14:01.070811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:01.155834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:01.168314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d431-b019-465e-b502-1dd761a30d93 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:01.200981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:01.201605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:01.201883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:01.202152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] PATH_INFO: `/v3/projects/fa844cca27164026934da226ab06a70c` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:01.203275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] RBAC: Authorizing `identity:get_project(project_id=fa844cca27164026934da226ab06a70c)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:01.204690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b05f2-ca34-47b3-b06f-81a9b869a669 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:01.206297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 594/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 19 02:14:01 2022] GET /identity/v3/projects/fa844cca27164026934da226ab06a70c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:01.212355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:01.306412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b2eb-ffee-4234-af7b-77f39d5d683b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:01.337975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:01.338557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:01.338862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:01.339131 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:01.339839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=fa844cca27164026934da226ab06a70c, user.id=a489a64b0cde498d9dfdc75526792da9) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:14:01.340138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:01.341537 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d14cfb-d63f-4f50-971b-ecf58583ce17 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:01.346992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 606/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:14:01 2022] GET /identity/v3/role_assignments?user.id=a489a64b0cde498d9dfdc75526792da9&scope.project.id=fa844cca27164026934da226ab06a70c&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:11.196899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=22 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:11.344479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:56.024374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfb2ca-6b0f-4745-97fc-3acaea2957b9 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:56.025021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfb2ca-6b0f-4745-97fc-3acaea2957b9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:56.025021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfb2ca-6b0f-4745-97fc-3acaea2957b9 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:56.026557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 595/1201] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:14:56.031760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:56.032217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:56.032345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:56.052190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:14:56.054348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:14:56.158128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 607/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:14:56.433719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfb2ca-6b0f-4745-97fc-3acaea2957b9 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:56.570800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfb2ca-6b0f-4745-97fc-3acaea2957b9 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:56.618206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:56.618870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:56.619222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:56.619558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:56.632179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:56.634696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:14:56.652004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:14:56.653113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:14:56.654090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:14:56.654090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:14:56.654090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:14:56.654090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 596/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:14:56.659805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:56.798211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10a24c-322c-43b1-9fe6-e23aa8b61d4d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:56.833297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:56.842130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:56.843215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:56.843707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:56.844300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:56.845061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:14:56.845370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:56.846838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceda4e-e80e-4d9e-9dab-5cd6f2e8dfe3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:56.871551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 608/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:56.872874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:56.935995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:57.003074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f908b-00c1-4ef5-9f32-20b9bf2ef04e None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:57.042980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:57.043692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:57.043973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:57.044299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:57.045025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:57.046525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fc706-681b-4878-a998-335c585bfde8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:57.072346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 597/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 19 02:14:56 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:14:59.113552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af00d-f6ca-4686-95e5-2aad082a35df None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:59.114248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af00d-f6ca-4686-95e5-2aad082a35df None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:59.114248 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af00d-f6ca-4686-95e5-2aad082a35df None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:59.115715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 609/1206] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:14:59.121498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:59.121943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:59.122214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:59.140508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:14:59.141800 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:14:59.213104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 598/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:14:59.484329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af00d-f6ca-4686-95e5-2aad082a35df None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:59.616979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af00d-f6ca-4686-95e5-2aad082a35df None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:59.653790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:59.654392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:59.654754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:59.654980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:59.666511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:14:59.673528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:14:59.675314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:14:59.676228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 610/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:14:59.680595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:59.722191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:59.787122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cdb8-ee58-4995-bd7c-98ad0da4fdc4 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:59.824876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:59.825486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:59.827702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:59.827702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:14:59.827702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:14:59.827702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:14:59.828418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:14:59.837743 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 599/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:14:59.844282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:14:59.897258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:14:59.953282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fcba1-7e5a-47d4-8536-be3e5754276a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:14:59.995493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:14:59.996345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:14:59.996733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:14:59.997119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:00.009021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:00.010691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:00.028662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:00.030040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:00.031004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:00.031004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:00.031004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:00.031004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 611/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:15:00.036999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:00.157178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:00.160456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1fac-7c6b-4485-b58e-0269c80600ad None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:00.201797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:00.202705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:00.203113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:00.203493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:00.204235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:00.204851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:00.206734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:00.230915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 600/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:00.232413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:00.348914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed51e-0b06-48aa-b17e-de8e8c6ee194 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:00.350549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:00.387674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:00.388819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:00.388819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:00.388819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:00.396549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:00.398552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:00.411125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:00.412158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:00.413165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 612/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:00.417763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:00.525386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1918ed6-77bf-4512-87bc-5d37bb291b28 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:00.562796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:00.563405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:00.563771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:00.564008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:00.564833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:00.565231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:00.567897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:00.589065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 601/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:00.595279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:00.705879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c27-39e8-416f-988e-e8948296f5f0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:00.746040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:00.746706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:00.747072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:00.747257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:00.781979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:00.823562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:00.825153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:00.949364 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 613/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:15:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 02:15:00.951015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:00.974831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:01.059968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733ac2-90b3-432c-a5ba-abed95d9ee4b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:01.098135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:01.098767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:01.099090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:01.099328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:01.111799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:01.113315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:01.130108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:01.131533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:01.132645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:01.132645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:01.132645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:01.132645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 602/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:01.137780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:01.206239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:01.248835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa5590-bfca-44b9-ac48-f0732d9f379a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:01.287310 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:01.288731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:01.289012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:01.289286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:01.289926 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:01.290229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:01.291615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:01.308431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 614/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:01.309613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:01.387410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:01.421219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af95e-4314-462e-a61e-2616f1dd4cc6 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:01.466238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:01.466901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:01.467181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:01.467454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:01.474371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:01.476484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:01.493385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:01.494520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:01.496075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 603/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:01.501524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:01.629504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794acc-f373-4c73-8c60-fd2d5a2f666d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:01.659465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:01.676538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:01.677548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:01.677869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:01.678144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:01.678982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:01.679289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:01.680709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7251e-ff3f-494d-bda0-b49b34828e10 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:01.692960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 615/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:01.698880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:01.809231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec587cf-af48-4e0a-b30e-5e3f0095e312 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:01.841673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:01.848006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:01.848699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:01.849102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:01.849410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:01.850195 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=a8f688eefaca493eab31cacad26e6548) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:01.850577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:01.852155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5643515-739b-477d-bb04-d67fd6452870 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:01.858656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 604/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:15:01 2022] GET /identity/v3/role_assignments?user.id=a8f688eefaca493eab31cacad26e6548&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:04.103600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a64b9-ef1a-4175-a123-a2751de2ad92 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:04.104178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a64b9-ef1a-4175-a123-a2751de2ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:04.104178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a64b9-ef1a-4175-a123-a2751de2ad92 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:04.105910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 616/1220] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:04.111250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:04.111705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:04.111833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:04.130240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:04.131560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:04.204193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 605/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:15:04.502018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a64b9-ef1a-4175-a123-a2751de2ad92 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:04.625234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a64b9-ef1a-4175-a123-a2751de2ad92 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:04.662795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:04.664183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:04.664557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:04.664999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:04.676858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:15:04.682034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:04.683149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:04.684078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 617/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:04.689497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:04.797340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f622ac-4df7-448a-ae27-ff6c408effe3 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:04.824659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:04.837777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:04.838532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:04.838960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:04.839570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:04.840336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:04.840864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:04.842332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:04.851519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 606/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:04.857280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:04.906695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:04.973773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7bef4-0bcb-48bc-b93c-b757aa47e0eb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.012991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.013622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.013902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.014174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.025453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.026927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:05.041637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:05.042775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:05.043706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:05.043706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:05.043706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:05.043706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 618/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:05.048957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.157317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398c323-62f8-409f-8d1f-531871fe0e1d None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.199788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.200386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.200667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.200941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.201579 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:05.201884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.203282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.215875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 607/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:05.221870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.325648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:05.332475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f0d6-9fa0-4fe7-81d2-cbbb65ac121d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.368218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.368848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.369134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.369409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.376834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.378259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:05.389230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:05.390355 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:05.391541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 619/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:05.396676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.446217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:05.500471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514805a-9e9e-48e4-bc96-4a5aa4d5113b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.536398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.537105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.537459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.537774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.539324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:05.539642 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.541431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.560683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 608/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:05.566394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.676803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a03c3-4f46-4bca-a3ef-3b8739ef3156 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.711910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.712543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.712849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.713101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.724475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.725936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:05.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:05.741375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:05.742663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:05.742663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:05.742663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:05.742663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 620/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:05.747241 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.858644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06ccf-8369-4e2c-8bba-2cf1c23c034b None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:05.860957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:05.892960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:05.893570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:05.893854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:05.894128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:05.894798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:05.895158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:05.896480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:05.908928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 609/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:05.914461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:05.923843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:06.021211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fe06-2401-4b34-9da0-8327970b7e96 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:06.060253 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:06.061068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:06.061182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:06.061415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:06.069678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:06.071157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:06.082367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:06.083569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:06.084841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 621/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:06.089774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:06.195215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9bbc-6016-444d-b5b6-33238874e03f None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:06.230695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:06.231337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:06.231584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:06.231854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:06.232536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:06.232837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:06.234254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e950c-c8a0-4dda-a49a-a3dbeb952c86 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:06.246789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 610/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:06.252930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:06.322079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:06.362089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa4983-2293-4b24-a82d-a184b8d9e2a4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:06.402225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:06.402998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:06.403379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:06.403757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/a8f688eefaca493eab31cacad26e6548/roles/832456078b8a456fbc40368454bf106a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:06.420626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=a8f688eefaca493eab31cacad26e6548, role_id=832456078b8a456fbc40368454bf106a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:06.422357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b42e-636b-464a-ae77-b03c24b32e90 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:06.437566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 622/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:15:06 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/a8f688eefaca493eab31cacad26e6548/roles/832456078b8a456fbc40368454bf106a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:15:08.313471 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed2af-dced-4efa-9e6e-3153b1ace211 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:08.314034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed2af-dced-4efa-9e6e-3153b1ace211 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:08.314034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed2af-dced-4efa-9e6e-3153b1ace211 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:08.315602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 611/1233] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:15:08.320631 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:08.321135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:08.321236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:08.340510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:08.341771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:08.411993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 623/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:15:08.721652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ed2af-dced-4efa-9e6e-3153b1ace211 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:08.747345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:08.836137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ed2af-dced-4efa-9e6e-3153b1ace211 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:08.872806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:08.873498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:08.873775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:08.874042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:08.885707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:15:08.890301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:08.891476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:08.892428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 612/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 19 02:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:08.897435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:08.947907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:09.008007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e20822-5024-4cdc-9b85-8c8b1ce6ba99 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.044331 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.044965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.045211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.045477 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.046138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:09.046461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.047879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:09.056740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 624/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 19 02:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:09.062549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:09.156075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:09.175185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1dc9-c2ec-4183-b93e-143ee54a7c2c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.213162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.213867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.214150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.214708 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.224916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.226998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:09.241374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:09.247343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:09.248434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:09.248434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:09.248434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:09.248434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 613/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:09.248700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:09.351303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75822ab-4368-4142-8be5-ea94d4369e71 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.360374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:09.386601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.387219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.387503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.387806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.388415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:09.388705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.390063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:09.402704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 625/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:09.408573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:09.515688 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb555f-a2b5-4604-b013-cd3e32a31ebc None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.551881 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.552559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.552850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.553158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.556170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:09.561809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.563305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:09.580435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:09.581559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:09.582690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 614/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:15:09.588541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:09.696008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b7f0-7a7a-4902-826c-0e78a21ce96e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.733302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.733907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.734184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.734456 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.735218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:09.735528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.736955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:09.755009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 626/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:09.760841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:09.868032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba379e46-ce7d-49d1-9e38-96ccbf8e8ae8 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:09.905627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:09.906311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:09.906627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:09.906905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:09.973600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:09.981428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:09.982922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.088180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 615/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:15:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:15:10.094336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:10.124658 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:10.207805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea872667-6c3c-4b56-b145-b032935a71bc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:10.244508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:10.245009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:10.245288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:10.245558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:10.255391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:10.257319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:10.274600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:10.275789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:10.276834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:10.276834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:10.276834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:10.276834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 627/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:10.281792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:10.381270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:10.388095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a028c6-ec8e-42b9-94cb-0b4835fab0e1 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:10.424584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:10.425208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:10.425482 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:10.425817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:10.426475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:10.426945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:10.428322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.440450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 616/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:10.446550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:10.527406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:10.551182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb12b-38c0-480b-bdce-d6366351adaf None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:10.592740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:10.593443 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:10.593788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:10.594141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:10.603300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:10.605361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:10.622167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:10.623284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:10.624451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 628/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:10.630449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:10.742943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0003c-fa2d-4e7c-a6ae-e5462f49ed7c None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:10.777771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:10.778396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:10.778712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:10.778990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:10.779678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:10.779982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:10.781427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7dbb4-37e5-4721-b512-8013d83a8c3f None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.799750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 617/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:10.801337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:10.906418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6aed0-ad82-4221-ad8b-f5545b4164b3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:10.943924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:10.944544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:10.944810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:10.945081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:10.945808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] RBAC: Adding query filter params (role.id=832456078b8a456fbc40368454bf106a, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=a8f688eefaca493eab31cacad26e6548) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:10.946132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:10.947557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc234-566e-45f3-8748-2e30bc03d499 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:10.953485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 629/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:15:10 2022] GET /identity/v3/role_assignments?user.id=a8f688eefaca493eab31cacad26e6548&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=832456078b8a456fbc40368454bf106a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:13.104702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cfefb-f924-4aec-90cf-0780eaf815ff None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:13.105290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cfefb-f924-4aec-90cf-0780eaf815ff None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:13.105290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cfefb-f924-4aec-90cf-0780eaf815ff None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:13.106680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 618/1247] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:13.112426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:13.112955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:13.113049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:13.119666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:13.133275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:13.134472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:13.210652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 630/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:13.481637 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cfefb-f924-4aec-90cf-0780eaf815ff None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:13.502532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:13.598430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cfefb-f924-4aec-90cf-0780eaf815ff None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:13.638833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:13.639466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:13.639744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:13.640014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:13.650519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:15:13.655235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:13.658613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:13.659723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 619/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:13.662379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:13.768710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b65b0a-591e-4792-83b7-35e21d18b2da None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:13.802464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:13.808715 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:13.809330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:13.809612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:13.809889 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:13.810583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:13.810902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:13.812301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:13.824084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 631/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:13.829931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:13.914671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:13.939232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ea81-e6be-49a3-9717-9991c1f74533 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:13.977014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:13.977651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:13.977922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:13.978183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:13.988394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:13.990049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:14.006317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:14.007539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:14.008418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:14.008418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:14.008418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:14.008418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 620/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:14.013773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:14.117511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9ae3-ee7a-4333-9c6b-b09519585c98 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:14.154289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:14.155029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:14.155307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:14.155596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:14.156330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:14.156664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:14.158158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:14.176344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 632/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:14.179333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:14.286282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1e9e-e1a0-4f23-8a93-ce3d5c470881 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:14.313349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:14.322551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:14.323290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:14.323594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:14.323930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:14.333016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:14.334760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:14.348011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:14.349181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:14.350394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 621/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:14.355644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:14.415652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:14.464181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dc3fb-b4e7-460d-b039-88b99245bd16 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:14.499640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:14.500251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:14.500539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:14.500811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:14.501569 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:14.501876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:14.503328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:14.521524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 633/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:15:14.527530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:14.650987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e40-74da-45f6-970f-655f6c0fa852 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:14.687670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:14.688211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:14.688499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:14.688780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:14.748773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:14.763198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:14.764670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:14.868251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 622/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:15:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:15:14.874032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:14.981179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2f4e-e519-4ed5-95e8-dfc3bc807b76 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:14.995783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:15.019787 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2295821-f453-4895-9f94-75004efab504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:15.020472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2295821-f453-4895-9f94-75004efab504 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:15.020751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2295821-f453-4895-9f94-75004efab504 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:15.021067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2295821-f453-4895-9f94-75004efab504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:15.032974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2295821-f453-4895-9f94-75004efab504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:15.034493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2295821-f453-4895-9f94-75004efab504 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e2295821-f453-4895-9f94-75004efab504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:15.051044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:15.052127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:15.053054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:15.053054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:15.053054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:15.053054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 634/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:15.058448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:15.154329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:15.168346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d26051-8abf-45a9-8100-95b95e0c6abf None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:15.205294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:15.205969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:15.206178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:15.206449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:15.207140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:15.207444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:15.208844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:15.227540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 623/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:15.229121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2295821-f453-4895-9f94-75004efab504 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:15.332354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2295821-f453-4895-9f94-75004efab504 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:15.367860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:15.368510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:15.368789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:15.369061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:15.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:15.377839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:15.389934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:15.390943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:15.392034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 635/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:15.397869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:15.499732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352cd3-4a76-4538-adcf-d4d363c58643 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:15.534168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:15.534814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:15.535098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:15.535370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:15.536061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:15.536360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:15.537791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb820d0-4adf-493a-9bb1-c70ee3b88a25 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:15.549957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 624/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:15.556278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:15.584246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:15.668181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a36a7-aadb-4bf1-843f-2fe1befd6d1a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:15.701449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:15.702050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:15.702327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:15.702645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:15.703372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=a8f688eefaca493eab31cacad26e6548) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:15.703678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:15.705083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435e1bb-efee-41bd-8d0b-8b5f2dac591e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:15.710934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 636/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:15:15 2022] GET /identity/v3/role_assignments?user.id=a8f688eefaca493eab31cacad26e6548&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:17.561816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba70f9-82bd-4e9c-b6fd-d7a4f6d2baa6 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:17.562369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba70f9-82bd-4e9c-b6fd-d7a4f6d2baa6 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:17.562369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba70f9-82bd-4e9c-b6fd-d7a4f6d2baa6 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:17.563661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 625/1261] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:17.569835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:17.570292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:17.570763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:17.590905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:17.592103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:17.657098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 637/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:17.920452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba70f9-82bd-4e9c-b6fd-d7a4f6d2baa6 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:17.931873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.019480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba70f9-82bd-4e9c-b6fd-d7a4f6d2baa6 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.052261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.052875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.053157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.053457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.063141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:15:18.067783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:18.068872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:18.070079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 626/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:18.074751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.092884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.170751 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b1e0-3cae-4cea-a08f-fb0cd5b5d518 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.202386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.203019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.203300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.203573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.204227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:18.204526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.205874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:18.214022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 638/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:18.219879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.283915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.316115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aab95-99d1-4529-ba00-108d85fc7d9a None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.349480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.350119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.350933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.351205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.361061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.362507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:18.376391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:18.377546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:18.378707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:18.378707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:18.378707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:18.378707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 627/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:18.383660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.460571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.479038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663381e-63b8-44fa-9f9f-131e668b6fb8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.510460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.511071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.511350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.511622 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.512244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:18.512541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.513882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:18.525548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 639/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 02:15:18.531264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.633873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b14e4-cf33-431f-84b8-3ace6b496a96 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.652892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.667115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.667730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.668017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.668290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.675309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.676732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:18.687274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:18.688367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:18.689634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 628/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:18.694722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.791679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe40d22-a2a5-4f33-874c-a0be930d4687 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.825663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.826259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.826540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.826842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.827557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:18.827860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.829274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:18.837570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:18.846079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 640/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:18.851882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:18.946684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc018ac7-18d2-4379-a950-7656895862ca None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:18.978174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:18.978866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:18.979143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:18.979411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:18.989300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:18.991276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:19.004525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:19.005608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:19.007304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:19.007304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:19.007304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:19.007304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 629/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:19.011830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:19.107597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a27f-ec2b-43a7-a3a6-d583813bcea3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:19.139647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:19.140231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:19.140510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:19.140783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:19.141868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:19.142171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:19.143546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:19.154583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 641/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:19.160166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:19.191371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:19.257400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295bbd-8f27-43ba-8003-25ef1d3ec7d9 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:19.289369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:19.289974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:19.290250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:19.290520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:19.296859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:19.298329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:19.309565 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:19.310626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:19.311908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 630/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:19.316387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:19.373987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:19.413729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65dd86-094c-4425-a77a-aa729f6e25e7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:19.445428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:19.446019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:19.446298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:19.446594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:19.447287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:19.447589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:19.448981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755637-d31b-455f-af26-5c639ddf96af None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:19.460867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 642/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:19.467014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:19.555115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:19.563865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215a2-38f7-4ec9-b016-106239a5b592 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:19.603989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:19.604770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:19.605108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:19.605402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] PATH_INFO: `/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/a8f688eefaca493eab31cacad26e6548/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:19.607749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] RBAC: Authorizing `identity:create_grant(project_id=033977d6eb2040e493bb4b576bb3af6f, user_id=a8f688eefaca493eab31cacad26e6548, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:19.609396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92062-d547-4ba0-88c2-29417f8f4089 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:19.622435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 631/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 19 02:15:19 2022] PUT /identity/v3/projects/033977d6eb2040e493bb4b576bb3af6f/users/a8f688eefaca493eab31cacad26e6548/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:15:21.452327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0cac4-186a-4e93-8191-162ec94025e3 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:21.452825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0cac4-186a-4e93-8191-162ec94025e3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:21.452825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0cac4-186a-4e93-8191-162ec94025e3 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:21.454115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 643/1274] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:21.459449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:21.459864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:21.460007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:21.478219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:21.479452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:21.543263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 632/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:21.812855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0cac4-186a-4e93-8191-162ec94025e3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:21.909054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0cac4-186a-4e93-8191-162ec94025e3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:21.925809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:21.942092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:21.942730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:21.943009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:21.943276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:21.952925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 02:15:21.957498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:21.958614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:21.960129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 644/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 19 02:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:21.965141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.042723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:22.060601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de989c-1630-4a8b-9db1-1123faf0b380 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.093815 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.094352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.094657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.094934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.095588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:22.095890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.097254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:22.104992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 633/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 19 02:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:22.110691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.208860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affeb8d-ec3d-460b-87f1-a0a18afedff7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.241706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.242325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.242628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.242906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.252494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.253931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:22.268338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:22.269395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:22.270300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:22.270300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:22.270300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:22.270300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 645/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:22.275899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.371844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e5dd-598b-41da-96b0-5cf5906a2602 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.404480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.405068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.405351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.405629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.406262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:22.406589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.407967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:22.419398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 634/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:22.424789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.454763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:22.522580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94326-3df2-4870-9d8a-4d422320b715 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.554489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.555136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.555419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.555697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.562753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.564166 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 02:15:22.575407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:22.576556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:22.577819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 646/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:22.582106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.585769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:22.678959 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75e1a7-aecf-4648-b116-5b5643237ba5 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.711725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.712319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.712602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.712875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.713596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:22.713903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.715605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:22.732044 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 635/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 19 02:15:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:22.737618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:22.825505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:22.841152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299257d-8eb8-44b1-aba4-1ba623028025 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:22.873935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:22.874527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:22.874839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:22.875113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:22.938273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:22.939680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.022651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:23.032970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 647/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 19 02:15:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 02:15:23.039354 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:23.097250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:23.134598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc1078-1e79-4f21-bff8-82a2ffbbe9e4 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:23.168174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:23.168792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:23.169069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:23.169340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:23.179452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:23.180887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 02:15:23.194774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:23.195707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 02:15:23.196772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 02:15:23.196772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 02:15:23.196772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:23.196772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 636/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:23.201513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:23.296312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e4c2e-0cb8-451c-ae79-f6609cf5708e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:23.328566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:23.329156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:23.329436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:23.329707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:23.330338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:23.330681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:23.332024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.343484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 648/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 19 02:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:23.348865 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:23.443707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72e1b-8c56-4dd0-9de8-0aa9d997d9ad None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:23.456540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:23.477255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:23.477858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:23.478136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:23.478407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:23.484759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:23.486182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 02:15:23.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:23.497883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: ERROR keystone.server.flask.application Aug 19 02:15:23.499006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 637/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 19 02:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:23.503833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:23.551884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:23.600237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c8a-1c19-471c-b448-8c0388bb6e12 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:23.631842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:23.632424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:23.632706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:23.632973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:23.633648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:23.633948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:23.635368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104a237-9ed5-4315-ae7a-c326f69acffc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.646649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 649/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 19 02:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:23.653135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:23.748806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f48ff9-ca12-4f40-aa13-86625f9b6574 None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:23.781768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:23.782352 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:23.782661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:23.782932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:23.783640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] RBAC: Adding query filter params (role.id=5af3d5a7f1954ca192b73e15ec944747, scope.project.id=033977d6eb2040e493bb4b576bb3af6f, user.id=a8f688eefaca493eab31cacad26e6548) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:23.783940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:23.785435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de562e1e-7853-4bde-8a85-8a29ab58d767 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:23.790876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 638/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 19 02:15:23 2022] GET /identity/v3/role_assignments?user.id=a8f688eefaca493eab31cacad26e6548&scope.project.id=033977d6eb2040e493bb4b576bb3af6f&role.id=5af3d5a7f1954ca192b73e15ec944747 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:25.672487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67925-ff1a-440f-b807-67073366dadd None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:25.673001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67925-ff1a-440f-b807-67073366dadd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:25.673091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67925-ff1a-440f-b807-67073366dadd None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:25.674363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 650/1288] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:25.680209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:25.680596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:25.680769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:25.699008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:25.700203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:25.728805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:25.767429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 639/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 02:15:26.031555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba67925-ff1a-440f-b807-67073366dadd None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:26.130728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba67925-ff1a-440f-b807-67073366dadd None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:26.140897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:26.164884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:26.165508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:26.165786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:26.166057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] PATH_INFO: `/v3/services/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:26.166664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:26.168032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:26.176485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:26.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:26.179190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 651/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:15:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:26.184081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:26.277993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f7d4-9a5e-46d4-bd88-17f6a04dfb26 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:26.310269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:26.310828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:26.311108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:26.311379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:26.311996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:26.312296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:26.313645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e700d7-fd2f-4b71-9834-b1151f863a81 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:26.318215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 640/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 19 02:15:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:26.323738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:26.420726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fee2e-04b5-4e13-aa0a-93f35291c2db None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:26.451874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:26.452450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:26.452727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:26.452997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:26.453608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:26.453905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:26.455260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1d4e-00c3-4ea6-ae49-a0bf75a25835 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:26.459947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 652/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 19 02:15:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:28.331127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63139-ac9b-423c-8574-b3d9e17387ea None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:28.331640 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63139-ac9b-423c-8574-b3d9e17387ea None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:28.331753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb63139-ac9b-423c-8574-b3d9e17387ea None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:28.333017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 641/1293] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:28.338124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6a981-4c0b-45e1-906d-2160ff6cbad0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:28.338540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6a981-4c0b-45e1-906d-2160ff6cbad0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:28.338727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6a981-4c0b-45e1-906d-2160ff6cbad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:28.356949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-27f6a981-4c0b-45e1-906d-2160ff6cbad0 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:28.358116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-27f6a981-4c0b-45e1-906d-2160ff6cbad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:28.386635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:28.423162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 653/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:28.706294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb63139-ac9b-423c-8574-b3d9e17387ea None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:28.738016 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:28.806363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb63139-ac9b-423c-8574-b3d9e17387ea None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:28.840299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:28.840891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:28.841175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:28.841452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:28.842090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:28.843480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ba555-c137-4a10-a948-20b71bc40990 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:28.857183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 642/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 19 02:15:28 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:15:30.745396 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7172ba-7728-4c9d-9998-7255d2c49ed9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:30.745977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7172ba-7728-4c9d-9998-7255d2c49ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:30.745977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7172ba-7728-4c9d-9998-7255d2c49ed9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:30.747297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 654/1296] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:30.752385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:30.752774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:30.752968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:30.770966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:30.772242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:30.842442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 643/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:31.108768 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7172ba-7728-4c9d-9998-7255d2c49ed9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:31.206465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7172ba-7728-4c9d-9998-7255d2c49ed9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:31.238829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:31.239420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:31.239699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:31.239971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:31.240544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:31.242510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:31.250906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:31.252238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:31.253353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 655/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:15:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 02:15:31.257950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:31.275528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:31.353178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418424b3-b560-4e37-9cdf-23cb682fd534 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:31.385484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:31.386073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:31.386353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:31.386654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:31.387277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:31.387578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:31.388930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:31.393772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 644/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 19 02:15:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:31.399527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:31.430841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:31.496255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361bb90-3beb-4819-9ffd-c872c985caa6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:31.528371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:31.528958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:31.529237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:31.529510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:31.530197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] RBAC: Adding query filter params (interface=public, service_id=71599445d90a44f69fd7912fb9ff3726, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:31.530503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:31.531905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c72865-ff41-4491-af47-0bc2787e3489 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:31.536666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 656/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 19 02:15:31 2022] GET /identity/v3/endpoints?service_id=71599445d90a44f69fd7912fb9ff3726&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:31.542724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:31.627673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:31.648376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f90c5-9e62-407f-9a72-15a928e4e9ad None admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:31.682882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:31.683479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:31.683755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:31.684025 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:31.684616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:31.685963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3cc9b-a366-4121-9238-b02ec7c87e18 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:31.692478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 645/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 19 02:15:31 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:15:33.546329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced205ae-715e-4510-afa9-d316b84781b5 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:33.546868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced205ae-715e-4510-afa9-d316b84781b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:33.546868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced205ae-715e-4510-afa9-d316b84781b5 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:33.548200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 657/1302] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:15:33.553152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:33.553597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:33.553698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:33.571723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:15:33.572886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:15:33.636371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 646/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:15:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 02:15:33.904274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced205ae-715e-4510-afa9-d316b84781b5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:33.997018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:34.004036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced205ae-715e-4510-afa9-d316b84781b5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:34.036836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:34.037475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:34.037763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:34.038040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:34.038639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:34.040167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 02:15:34.048620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 02:15:34.049753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: ERROR keystone.server.flask.application Aug 19 02:15:34.050626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 658/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 19 02:15:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 02:15:34.056181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:34.130245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:34.153390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998b55a-7638-4911-a236-836fb8d6b7be None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:34.187026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:34.187627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:34.187907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:34.188181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] PATH_INFO: `/v3/services` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:34.188805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:15:34.189108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:34.190465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5513410-de78-4687-a5f0-b98a58decf45 None admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:34.195431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 647/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 19 02:15:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:15:34.201286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:15:34.297939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde334-e80b-4be2-b566-37e029cfdcc6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:15:34.330440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:15:34.331057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:15:34.331338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:15:34.331609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:15:34.332260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:15:34.333606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4207395-59dc-4174-acb4-c4fe658798af None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:15:34.352545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 659/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:15:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:15:44.193474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=30 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:15:44.347861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:37.438780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8124c-8358-440a-9915-084296f1f113 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:37.440057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8124c-8358-440a-9915-084296f1f113 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:37.440553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8124c-8358-440a-9915-084296f1f113 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:37.446050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 648/1307] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:37.447431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0519a-8e35-4398-9dfe-b90323b4ea8d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:37.447883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0519a-8e35-4398-9dfe-b90323b4ea8d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:37.447971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0519a-8e35-4398-9dfe-b90323b4ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:37.536282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-26f0519a-8e35-4398-9dfe-b90323b4ea8d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:37.537598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-26f0519a-8e35-4398-9dfe-b90323b4ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:37.715427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 660/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:16:38.008390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:38.008824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:38.009270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:38.010953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 649/1309] 10.222.0.45 () {54 vars in 965 bytes} [Fri Aug 19 02:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:38.017134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b615a-dbee-44f2-9947-e53b5fb048c8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:38.017425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b615a-dbee-44f2-9947-e53b5fb048c8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:38.017700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b615a-dbee-44f2-9947-e53b5fb048c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:38.118943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c02b615a-dbee-44f2-9947-e53b5fb048c8 None None] MFA Rules not processed for user `52a425657bc44ce6b62595045bd5da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:38.120180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c02b615a-dbee-44f2-9947-e53b5fb048c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:38.143723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:38.206256 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 661/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Fri Aug 19 02:16:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:16:38.215206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:38.217021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:38.332492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18a71e-3b01-4434-9e43-9839c1fbfdae None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:38.408176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:38.408814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:38.409097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:38.409380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:38.410995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:38.468876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:38.529587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:38.531197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b809-090f-4054-b233-372a80a52047 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:38.550837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 650/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:40.718451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:40.719012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:40.719125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:40.720410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 662/1312] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:40.725576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114ef3-1726-43c8-920c-621886cf9004 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:40.725961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114ef3-1726-43c8-920c-621886cf9004 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:40.726135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114ef3-1726-43c8-920c-621886cf9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:40.796510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-14114ef3-1726-43c8-920c-621886cf9004 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:40.797399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-14114ef3-1726-43c8-920c-621886cf9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:40.895315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 651/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:41.177674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:41.179925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:41.282760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af517a-2f46-40c5-9553-95f5c22364cc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:41.351561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:41.354434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:41.355296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:41.355771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:41.356201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:41.357837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:41.467974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:41.469317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066144d-d4a2-43e2-968a-b7544d99c8df service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:41.487612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 663/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:43.687938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:43.688476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:43.688476 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:43.690003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 652/1315] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:43.695547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf82a4-84f8-4965-8ce2-42b5ed61b994 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:43.695938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf82a4-84f8-4965-8ce2-42b5ed61b994 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:43.696101 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf82a4-84f8-4965-8ce2-42b5ed61b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:43.760840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8cdf82a4-84f8-4965-8ce2-42b5ed61b994 None None] MFA Rules not processed for user `c645bfdb45ef433289f7ec009efccb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:43.762052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8cdf82a4-84f8-4965-8ce2-42b5ed61b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:43.813964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:43.857380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 664/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:44.142593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:44.144153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:44.153861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:44.248040 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60bcd-1d92-44ab-aa94-3dc95475b14f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:44.318542 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:44.319168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:44.319473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:44.319745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:44.321316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:44.382508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:44.428172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:44.429545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc3428-a490-49ad-831a-a47a38d8d455 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:44.447320 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 653/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:46.881196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:46.881704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:46.882373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:46.883741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 665/1318] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:46.888778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933906b2-986f-4d6e-bbfa-f726756b0aee None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:46.889155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933906b2-986f-4d6e-bbfa-f726756b0aee None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:46.889336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933906b2-986f-4d6e-bbfa-f726756b0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:46.953628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-933906b2-986f-4d6e-bbfa-f726756b0aee None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:46.954846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-933906b2-986f-4d6e-bbfa-f726756b0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:47.049324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 654/1319] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:47.336342 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:47.337904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:47.440178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e247c9-7a59-436b-9286-8c14f209acc5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:47.512294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:47.512898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:47.513182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:47.513454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:47.515082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:47.522381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:47.641177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:47.642775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fb87b-1a53-460f-a783-79910d49db56 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:47.661183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 666/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:50.235790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:50.236356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:50.236356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:50.237871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 655/1321] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:50.242904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0945f-048b-4c85-9153-d27f97304588 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:50.243350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0945f-048b-4c85-9153-d27f97304588 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:50.243460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0945f-048b-4c85-9153-d27f97304588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:50.308638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f7f0945f-048b-4c85-9153-d27f97304588 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:50.309841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f7f0945f-048b-4c85-9153-d27f97304588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:50.367543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:50.407954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 667/1322] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:50.695485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:50.697014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:50.717003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:50.800242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95d57f-acca-4fc6-83d8-a94e9a666603 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:50.872769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:50.873302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:50.873578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:50.873850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:50.875461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:50.945816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:50.982919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:50.984368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f5cf0-e40c-49ec-ac00-cbfa50b0c25d service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:51.002858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 656/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:52.956300 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:52.956835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:52.956835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:52.958162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 668/1324] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:52.963408 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bde1-4613-46c8-8933-890dce0107bd None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:52.963790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bde1-4613-46c8-8933-890dce0107bd None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:52.963955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bde1-4613-46c8-8933-890dce0107bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:53.030969 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1075bde1-4613-46c8-8933-890dce0107bd None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:53.032165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1075bde1-4613-46c8-8933-890dce0107bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:53.126797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 657/1325] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:53.407934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:53.409513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:53.520535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a96d0-ed5b-4532-9935-59aa7bc58080 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:53.594374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:53.595005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:53.595280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:53.595549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:53.597125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:53.613292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:53.703318 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:53.704664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37143f4-e853-43b4-baea-82b52451b413 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:53.723409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 669/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:55.657119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab824af-88cd-462e-88da-60eac71169af None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:55.657653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab824af-88cd-462e-88da-60eac71169af None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:55.657653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab824af-88cd-462e-88da-60eac71169af None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:55.659067 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 658/1327] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:55.665084 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f29e13-8489-4b52-b7ba-db532fcf09bb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:55.665588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f29e13-8489-4b52-b7ba-db532fcf09bb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:55.665711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f29e13-8489-4b52-b7ba-db532fcf09bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:55.733307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-69f29e13-8489-4b52-b7ba-db532fcf09bb None None] MFA Rules not processed for user `c645bfdb45ef433289f7ec009efccb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:55.734508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-69f29e13-8489-4b52-b7ba-db532fcf09bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:55.798560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:55.831804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 670/1328] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:56.114515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab824af-88cd-462e-88da-60eac71169af None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:56.116061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5ab824af-88cd-462e-88da-60eac71169af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:56.150892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:56.229916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab824af-88cd-462e-88da-60eac71169af None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:56.302201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:56.302845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:56.303125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:56.303399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:56.305466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:56.381058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:56.412920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:56.414400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab750-f83a-4b6a-89ac-f25ea18968ec service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:56.433133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 659/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:16:58.605380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:58.605910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:58.605910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:58.607242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 671/1330] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:16:58.612379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6297c0-a585-4963-91db-f3301087b071 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:58.612796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6297c0-a585-4963-91db-f3301087b071 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:58.612955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6297c0-a585-4963-91db-f3301087b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:58.677204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-ec6297c0-a585-4963-91db-f3301087b071 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:16:58.678382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ec6297c0-a585-4963-91db-f3301087b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:58.773737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 660/1331] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:16:59.054367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:16:59.055930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:59.156070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87386e97-f648-4ab1-8752-3263cd9f522c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:16:59.230357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:16:59.230989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:16:59.231274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:16:59.231546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:16:59.233128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:16:59.258511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:16:59.337765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:16:59.339223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51151-964e-41fa-a535-e74a9ff1cd7e service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:16:59.357871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 672/1332] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:01.266087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:01.266644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:01.266644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:01.268053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 661/1333] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:01.273196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26eca7-8855-42e0-aa72-dea8593a657a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:01.273616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26eca7-8855-42e0-aa72-dea8593a657a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:01.273752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26eca7-8855-42e0-aa72-dea8593a657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:01.338148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fe26eca7-8855-42e0-aa72-dea8593a657a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:01.339390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fe26eca7-8855-42e0-aa72-dea8593a657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:01.411255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:01.434412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 673/1334] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:01.723258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:01.724771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:01.763650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:01.826845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852063c0-9a22-4fe7-ba6d-883a730fe592 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:01.897988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:01.898595 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:01.898884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:01.899149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:01.900700 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:01.980985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:02.006267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:02.008278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a844b2c-9212-45b5-8d5a-eefc21ff3403 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:02.026402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 662/1335] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:04.242292 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:04.242846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:04.242846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:04.244219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 674/1336] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:04.249301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65773-aa8a-4073-a034-7ed9d9cdaf73 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:04.249712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65773-aa8a-4073-a034-7ed9d9cdaf73 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:04.249843 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65773-aa8a-4073-a034-7ed9d9cdaf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:04.315203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-28c65773-aa8a-4073-a034-7ed9d9cdaf73 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:04.316407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-28c65773-aa8a-4073-a034-7ed9d9cdaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:04.410012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 663/1337] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:04.696984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:04.698539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:04.800488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4831-4170-4965-8d36-2e2d58dc72a2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:04.871897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:04.872497 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:04.872779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:04.873055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:04.874667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:04.910760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:04.981840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:04.983233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498a99-1682-45fa-af23-12c4220cffe7 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:05.000556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 675/1338] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:08.758096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:08.758654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:08.758762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:08.760113 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 664/1339] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:08.765573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6872-e9c6-48dc-ad69-0199474ed8b5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:08.765985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6872-e9c6-48dc-ad69-0199474ed8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:08.766093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6872-e9c6-48dc-ad69-0199474ed8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:08.830972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-17aa6872-e9c6-48dc-ad69-0199474ed8b5 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:08.832163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-17aa6872-e9c6-48dc-ad69-0199474ed8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:08.919758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:08.931978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 676/1340] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:09.214670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:09.216260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:09.266692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:09.324065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd6e1a-e827-4ee8-bc30-ffcde9be63ed None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:09.399115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:09.399724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:09.399997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:09.400261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:09.401855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:09.492249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:09.508956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:09.510394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13e380-f4c0-478f-9a50-b4bbb128fe7e service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:09.530077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 665/1341] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:12.060002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:12.060449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:12.060545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:12.061899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 677/1342] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:12.066977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cfe9f-c362-4c8e-8aed-00fba5dd3cf3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:12.067379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cfe9f-c362-4c8e-8aed-00fba5dd3cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:12.067574 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cfe9f-c362-4c8e-8aed-00fba5dd3cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:12.136038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1e0cfe9f-c362-4c8e-8aed-00fba5dd3cf3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:12.137246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1e0cfe9f-c362-4c8e-8aed-00fba5dd3cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:12.233602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 666/1343] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:12.511002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:12.512616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:12.615923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f22b-6f02-4213-8ae0-7f51230ed478 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:12.687955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:12.688555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:12.688828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:12.689092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:12.690679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:12.735948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:12.803265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:12.805120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975092-58b2-403a-8b21-3cbe3017f590 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:12.824559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 678/1344] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:16.653362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9886e-7771-4e1b-bde5-13554b1acccf None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:16.653848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9886e-7771-4e1b-bde5-13554b1acccf None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:16.654134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9886e-7771-4e1b-bde5-13554b1acccf None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:16.655286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 667/1345] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:16.660623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37821a-8769-4a14-8906-92bd68b96a29 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:16.661129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37821a-8769-4a14-8906-92bd68b96a29 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:16.661233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37821a-8769-4a14-8906-92bd68b96a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:16.748954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1f37821a-8769-4a14-8906-92bd68b96a29 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:16.750182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1f37821a-8769-4a14-8906-92bd68b96a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:16.862728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:16.865370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 679/1346] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:17.158947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:17.159572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:17.160000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:17.162002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 668/1347] 10.222.0.45 () {54 vars in 965 bytes} [Fri Aug 19 02:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:17.168185 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c5a5-bad8-4af1-972d-6baa71366ece None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:17.168473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c5a5-bad8-4af1-972d-6baa71366ece None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:17.168749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18c5a5-bad8-4af1-972d-6baa71366ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:17.257624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2e18c5a5-bad8-4af1-972d-6baa71366ece None None] MFA Rules not processed for user `52a425657bc44ce6b62595045bd5da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:17.258905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2e18c5a5-bad8-4af1-972d-6baa71366ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:17.337833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 680/1348] 10.222.0.45 () {58 vars in 1062 bytes} [Fri Aug 19 02:17:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:17.347284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:17.348798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:17.409299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:17.456958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56b3f4-de26-46d9-a97f-84e918668c14 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:17.529604 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:17.530145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:17.530428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:17.530739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:17.532315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:17.637592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:17.641144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:17.643011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d5afd-a676-4348-a964-d63f7e933270 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:17.660851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 669/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:22.909420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41978-53c8-4ee7-8c46-56a6914d04e9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:22.910271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41978-53c8-4ee7-8c46-56a6914d04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:22.911394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41978-53c8-4ee7-8c46-56a6914d04e9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:22.913401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 681/1350] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:17:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:22.920616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6720-cce9-48ea-a758-5d637f5cbc93 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:22.921356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6720-cce9-48ea-a758-5d637f5cbc93 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:22.921829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6720-cce9-48ea-a758-5d637f5cbc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:23.050419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-b4ab6720-cce9-48ea-a758-5d637f5cbc93 None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:23.052428 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b4ab6720-cce9-48ea-a758-5d637f5cbc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:23.184145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 670/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:17:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:27.304321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac6c6-61e3-4cc0-8478-59476f563e48 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:27.304894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac6c6-61e3-4cc0-8478-59476f563e48 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:27.304894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac6c6-61e3-4cc0-8478-59476f563e48 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:27.306374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 682/1352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:27.311493 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353e60-d89f-463c-95d4-cc002e54db32 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:27.311992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353e60-d89f-463c-95d4-cc002e54db32 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:27.312260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353e60-d89f-463c-95d4-cc002e54db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:27.336054 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=59 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:27.370536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:27.395461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-64353e60-d89f-463c-95d4-cc002e54db32 None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:27.396840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-64353e60-d89f-463c-95d4-cc002e54db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:27.505387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 671/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:17:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:28.980045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56534c-9b52-4211-8ca4-fd3792cb7f52 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:28.980577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56534c-9b52-4211-8ca4-fd3792cb7f52 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:28.980577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56534c-9b52-4211-8ca4-fd3792cb7f52 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:28.981954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 683/1354] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:28.987142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3ee9-5c35-4902-b4c6-43b8f682b3da None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:28.987527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3ee9-5c35-4902-b4c6-43b8f682b3da None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:28.987834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3ee9-5c35-4902-b4c6-43b8f682b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:29.069732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-73cf3ee9-5c35-4902-b4c6-43b8f682b3da None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:29.071061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-73cf3ee9-5c35-4902-b4c6-43b8f682b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:29.115521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:29.188977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 672/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:17:32.376158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a86a-da04-4831-a069-7f4fcd0cd9d5 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:32.376781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a86a-da04-4831-a069-7f4fcd0cd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:32.376781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a86a-da04-4831-a069-7f4fcd0cd9d5 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:32.378029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 684/1356] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:17:32.383706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb195ed-e5cb-4610-9ff8-6a9f4a5da40c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:32.384148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb195ed-e5cb-4610-9ff8-6a9f4a5da40c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:32.384250 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb195ed-e5cb-4610-9ff8-6a9f4a5da40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:32.463562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3bb195ed-e5cb-4610-9ff8-6a9f4a5da40c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:32.464773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3bb195ed-e5cb-4610-9ff8-6a9f4a5da40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:32.588993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 673/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:17:32.898439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:32.899071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:32.899564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:32.901447 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 685/1358] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 19 02:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:32.911264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84d3-d1b7-48c1-94e9-16bdc9254427 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:32.911559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84d3-d1b7-48c1-94e9-16bdc9254427 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:32.911842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84d3-d1b7-48c1-94e9-16bdc9254427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:32.932904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:32.999405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-df1e84d3-d1b7-48c1-94e9-16bdc9254427 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:33.000918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-df1e84d3-d1b7-48c1-94e9-16bdc9254427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:33.132733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 674/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 19 02:17:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:17:33.140770 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:33.142387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:33.308991 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638119-24bd-435f-8d13-1a45af2961fe None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:33.389071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:33.431834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:33.432823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:33.433367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:33.433857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:33.435891 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:33.527877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:33.529480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cf2a3-f6fc-4ac7-9464-b05824492c55 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:33.547839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 686/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:35.671026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:35.671516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:35.671679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:35.678946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073edea-06ab-458f-98f3-32bdac4feb44 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:35.679423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073edea-06ab-458f-98f3-32bdac4feb44 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:35.679594 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073edea-06ab-458f-98f3-32bdac4feb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:35.682732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 675/1361] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:35.751041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d073edea-06ab-458f-98f3-32bdac4feb44 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:35.752436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d073edea-06ab-458f-98f3-32bdac4feb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:35.792187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:35.856217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 687/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:36.150041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:36.151809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:36.229971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:36.324013 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527914f0-1be9-4684-a9ac-68936764ab92 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:36.442999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:36.443611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:36.444469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:36.444749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:36.446621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:36.478901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:36.564362 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:36.565976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6577c-7b6d-48bc-8205-b65104916a34 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:36.586350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 676/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:38.822406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f908-c928-4026-9e46-47e1c6b57f91 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:38.822934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f908-c928-4026-9e46-47e1c6b57f91 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:38.822934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f908-c928-4026-9e46-47e1c6b57f91 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:38.824270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 688/1364] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:38.829699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9cdb-31f4-4535-8f55-51cf022492b8 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:38.830149 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9cdb-31f4-4535-8f55-51cf022492b8 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:38.830245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9cdb-31f4-4535-8f55-51cf022492b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:38.904593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4dae9cdb-31f4-4535-8f55-51cf022492b8 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:38.906200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4dae9cdb-31f4-4535-8f55-51cf022492b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:39.011455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:39.018883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 677/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:39.312793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:39.313077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:39.313541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:39.315772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 689/1366] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 19 02:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:39.322020 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d75-79a0-4559-afd1-531eb8ba338d None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:39.322330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d75-79a0-4559-afd1-531eb8ba338d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:39.322649 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d75-79a0-4559-afd1-531eb8ba338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:39.404500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4b7e8d75-79a0-4559-afd1-531eb8ba338d None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:39.405837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4b7e8d75-79a0-4559-afd1-531eb8ba338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:39.532943 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 678/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 19 02:17:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:39.541795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:39.543502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:39.710177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12602e07-dc5c-48d4-9e8a-609a0f966b3d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:39.732110 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:39.833205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:39.833883 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:39.834136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:39.834920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:39.836503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:39.930590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:39.932206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559e4a-96cb-4721-8043-46315058a0d2 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:39.950916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 690/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:17:40.632133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dbb4-9510-4906-aedf-e20a3cfa6cf4 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:40.632745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dbb4-9510-4906-aedf-e20a3cfa6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:40.632745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5dbb4-9510-4906-aedf-e20a3cfa6cf4 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:40.634228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 679/1369] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:40.639328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed47af-c74f-43df-836e-680b2ae3717e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:40.639621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed47af-c74f-43df-836e-680b2ae3717e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:40.639902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed47af-c74f-43df-836e-680b2ae3717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:40.673167 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:40.708106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-36ed47af-c74f-43df-836e-680b2ae3717e None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:40.709849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-36ed47af-c74f-43df-836e-680b2ae3717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:40.811910 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 691/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:41.397562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:41.398004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:41.398388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:41.399887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 680/1371] 10.222.0.45 () {54 vars in 964 bytes} [Fri Aug 19 02:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:41.404924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b542-c0f5-4c72-879a-8e9709bfc216 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:41.405457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b542-c0f5-4c72-879a-8e9709bfc216 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:41.405457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b542-c0f5-4c72-879a-8e9709bfc216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:41.486928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4b97b542-c0f5-4c72-879a-8e9709bfc216 None None] MFA Rules not processed for user `fae1e43e357649ceb0e7d0e6f0c0c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:41.488142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4b97b542-c0f5-4c72-879a-8e9709bfc216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:41.537006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:41.570617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 692/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Aug 19 02:17:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:41.578053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:41.579585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:41.632659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:41.690073 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719e78-0b3d-414d-884f-8a9021c1faf5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:41.774127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae1e43e357649ceb0e7d0e6f0c0c0ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:41.774977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:41.775427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:41.775831 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:41.777785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:41.904258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:41.921612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:41.923433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:41.941136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4a31-2dc3-47af-8876-1eea4a534554 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:41.941526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4a31-2dc3-47af-8876-1eea4a534554 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:41.942010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb4a31-2dc3-47af-8876-1eea4a534554 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:41.945064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 693/1373] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:17:41.949995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30118-3f38-4e92-b5b9-badc9bf0e3cc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:41.950287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30118-3f38-4e92-b5b9-badc9bf0e3cc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:41.950580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30118-3f38-4e92-b5b9-badc9bf0e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:41.954984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 681/1374] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:42.033664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6cf30118-3f38-4e92-b5b9-badc9bf0e3cc None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:42.035319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6cf30118-3f38-4e92-b5b9-badc9bf0e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:42.137820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 694/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:42.422613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:42.423817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:42.518866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557323b-fbcb-40ea-aa4f-14fcec4d24a4 service cinder] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:42.622870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:42.635170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:42.635797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:42.636053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:42.636337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:42.638155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:42.728659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:42.730251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af977996-9fd5-43a3-bb1e-53a1edca8442 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:42.749077 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 682/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:44.684198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:44.684748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:44.684844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:44.686231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 695/1377] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:44.691572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09715-48c3-45e9-ae7d-0e196aa51027 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:44.691984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09715-48c3-45e9-ae7d-0e196aa51027 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:44.692125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09715-48c3-45e9-ae7d-0e196aa51027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:44.757802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-68e09715-48c3-45e9-ae7d-0e196aa51027 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:44.759311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-68e09715-48c3-45e9-ae7d-0e196aa51027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:44.823420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:44.863686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 683/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:45.155317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:45.156817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:45.208876 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:45.306479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee7537-0396-4b4e-adb8-6bd21e55c582 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:45.471961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:45.472581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:45.472862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:45.473135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:45.474820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:45.490368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:45.588382 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:45.590252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb37d5-b0f3-49fd-9635-a51265a1d028 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:45.611121 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 696/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:47.572439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:47.573001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:47.573001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:47.574522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 684/1380] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:47.579567 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e3a0-2fb5-4ac8-aab1-553b0ebf3351 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:47.579967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e3a0-2fb5-4ac8-aab1-553b0ebf3351 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:47.580157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6e3a0-2fb5-4ac8-aab1-553b0ebf3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:47.651868 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-65b6e3a0-2fb5-4ac8-aab1-553b0ebf3351 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:47.653083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-65b6e3a0-2fb5-4ac8-aab1-553b0ebf3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:47.743002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:47.756850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 697/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:48.049262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:48.051041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:48.216757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075091b5-ad18-48ff-be74-70aa57beb4bc None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:48.279361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:48.351792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:48.352373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:48.352650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:48.352976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:48.354543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:48.449754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:48.451486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22df3f-3552-4c51-a804-190e4932c3ca service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:48.472478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 685/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:50.700415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:50.701095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:50.701095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:50.702380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 698/1383] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:50.709372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a4eb-3a71-404b-8cf6-afa8dba043e4 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:50.709953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a4eb-3a71-404b-8cf6-afa8dba043e4 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:50.709953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a4eb-3a71-404b-8cf6-afa8dba043e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:50.784833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-dad8a4eb-3a71-404b-8cf6-afa8dba043e4 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:50.786555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-dad8a4eb-3a71-404b-8cf6-afa8dba043e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:50.789390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:50.891761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 686/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:51.250925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:51.252855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:51.423676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b65f9e-1853-47ad-a316-4c5f3fccd739 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:51.492809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:51.544731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:51.545607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:51.545887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:51.546155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:51.547760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:51.672996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:51.674611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc9631-ad9e-4bb4-a2a7-66c6736d9158 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:51.693011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 699/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:17:54.221707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:54.222230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:54.222655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:54.225531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 687/1386] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:54.232660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32191a6-82f7-4dc4-962b-462f76f0e4af None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:54.233283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32191a6-82f7-4dc4-962b-462f76f0e4af None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:54.233283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32191a6-82f7-4dc4-962b-462f76f0e4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:54.317096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d32191a6-82f7-4dc4-962b-462f76f0e4af None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:54.319255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d32191a6-82f7-4dc4-962b-462f76f0e4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:54.468091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:54.562929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 700/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:54.923749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:54.925378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:55.063550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:55.081291 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7e8e1-9ad8-419e-bae4-a686c1705918 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:55.203784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:55.204393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:55.204673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:55.204945 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:55.206527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:55.295704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:55.297322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b42f5d-089f-4077-9be6-ef528666bfba service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:55.303545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:55.317343 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 688/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:56.912803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26605-9b97-4ec3-b1b3-686235dc4f0d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:56.913369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26605-9b97-4ec3-b1b3-686235dc4f0d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:56.913369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26605-9b97-4ec3-b1b3-686235dc4f0d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:56.914701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 701/1389] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:56.919950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af141f-1648-43b6-8d5e-52db1a22e97f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:56.920371 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af141f-1648-43b6-8d5e-52db1a22e97f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:56.920524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af141f-1648-43b6-8d5e-52db1a22e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:56.989397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-07af141f-1648-43b6-8d5e-52db1a22e97f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:56.990670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-07af141f-1648-43b6-8d5e-52db1a22e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.085420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 689/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:57.248874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526edb69-0a38-4a8f-9479-5219ce207ac8 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.249251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526edb69-0a38-4a8f-9479-5219ce207ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.249559 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526edb69-0a38-4a8f-9479-5219ce207ac8 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.250947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 702/1391] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:57.256281 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.256566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.256841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.322206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:57.323418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.344877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:57.382478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11791d-9c9c-441d-aca4-c6177ca811cd None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.382793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11791d-9c9c-441d-aca4-c6177ca811cd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.383065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11791d-9c9c-441d-aca4-c6177ca811cd None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.384363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 703/1392] 10.222.0.45 () {54 vars in 967 bytes} [Fri Aug 19 02:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:17:57.388820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.389104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.389374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.423913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 690/1393] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:57.463423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] MFA Rules not processed for user `18fe513fdeb442c6bbd2e2144169ba78`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:57.464548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.538790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 704/1394] 10.222.0.45 () {58 vars in 1064 bytes} [Fri Aug 19 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:17:57.546435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:57.547746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.638535 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b190bf-5ed1-4f92-ad26-1329e57c08d7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:57.701070 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:57.713728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:57.713895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe513fdeb442c6bbd2e2144169ba78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:57.714438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.714747 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.715019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.715175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.716553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.737309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:57.825778 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:57.827328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb33fc-e0f1-4b6b-aee8-625b08c7ccf4 service glance] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:57.833706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7202-a0ae-43d5-be2a-323ef6c36303 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:57.846057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 691/1395] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:17:57.960431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:57.961102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:57.961384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:57.961662 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:57.963286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:57.975337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:58.056108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:58.057960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b22d9-5a0b-479b-970f-a7e9a767e72b service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:58.078451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 705/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:17:58.592449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d647-0ff6-46a4-b2d1-5c8c094e7575 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:58.592968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d647-0ff6-46a4-b2d1-5c8c094e7575 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:58.593515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d647-0ff6-46a4-b2d1-5c8c094e7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:58.660255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-fd33d647-0ff6-46a4-b2d1-5c8c094e7575 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:58.662055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-fd33d647-0ff6-46a4-b2d1-5c8c094e7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:58.705685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:58.753771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 692/1397] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:58.799548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:58.799837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:58.800153 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:58.801541 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 706/1398] 10.222.0.45 () {54 vars in 943 bytes} [Fri Aug 19 02:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:17:58.807964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a0745-2abb-4cac-aa57-b8d872389a59 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:58.808260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a0745-2abb-4cac-aa57-b8d872389a59 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:58.808545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a0745-2abb-4cac-aa57-b8d872389a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:58.884394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-bf1a0745-2abb-4cac-aa57-b8d872389a59 None None] MFA Rules not processed for user `dc4349bca8444e65a321cf2bf2572ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:17:58.885583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-bf1a0745-2abb-4cac-aa57-b8d872389a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:58.990324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 693/1399] 10.222.0.45 () {58 vars in 1040 bytes} [Fri Aug 19 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:17:58.999550 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:17:59.001072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:59.135193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da349f-3385-47ca-88d1-f420a2b8e08a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:17:59.138136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:17:59.243835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:17:59.244441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:17:59.244719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:17:59.244992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:17:59.246661 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:17:59.327733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:17:59.329303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38f85-6256-4c22-a3f6-645039876476 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:17:59.337971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 707/1400] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:17:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:18:00.034979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:00.035548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:00.035656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:00.037177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 694/1401] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:00.043144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90967b-201f-43a2-8c42-1e8bd51d1953 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:00.043585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90967b-201f-43a2-8c42-1e8bd51d1953 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:00.043733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90967b-201f-43a2-8c42-1e8bd51d1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:00.090543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:00.113795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-da90967b-201f-43a2-8c42-1e8bd51d1953 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:00.115677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-da90967b-201f-43a2-8c42-1e8bd51d1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:00.228664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 708/1402] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:00.516772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:00.518359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:00.537298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:00.679652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc771-06f8-45d6-8755-030860b92651 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:00.773767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:00.801272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:00.804576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:00.804576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:00.804576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:00.804867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:00.901403 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:00.903069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443b55e-a9ad-493a-8ae8-7ef98432a06d service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:00.921794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 695/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:02.886328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:02.887350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:02.887624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:02.888980 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 709/1404] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:02.894246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bacf-ab3b-4ec1-9e8d-e2a35325b89a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:02.894726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bacf-ab3b-4ec1-9e8d-e2a35325b89a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:02.894888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bacf-ab3b-4ec1-9e8d-e2a35325b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:02.967015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-bd59bacf-ab3b-4ec1-9e8d-e2a35325b89a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:02.968481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-bd59bacf-ab3b-4ec1-9e8d-e2a35325b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:03.029855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:03.084033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 696/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:18:03.385767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:03.387616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:03.514144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:03.553873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edf5c2-5a29-4e36-9200-d6ab050c4aca None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:03.685534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:03.686215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:03.686501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:03.686837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:03.688450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:03.770968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:03.790057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:03.791863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf1374-a4dd-45e8-b23a-d15355d192fb service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:03.811769 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 710/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:05.773762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:05.775097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:05.775612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:05.777190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 697/1407] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:05.782247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4662-7e80-4ef4-8420-46144401fb95 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:05.782704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4662-7e80-4ef4-8420-46144401fb95 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:05.782845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4662-7e80-4ef4-8420-46144401fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:05.854350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0f8c4662-7e80-4ef4-8420-46144401fb95 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:05.855962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0f8c4662-7e80-4ef4-8420-46144401fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:05.959694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 711/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:06.251198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:06.254615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:06.415265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489d4c-2006-49db-a102-72bd2d8090a7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:06.453472 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:06.551525 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:06.552262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:06.552610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:06.552953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:06.554665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:06.666521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:06.668400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e793f-9139-44de-8446-f50ee92b3c68 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:06.704404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 698/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:15.957691 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=77 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:16.689609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=82 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:21.154409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b36f-4753-47c6-80ea-f8862b9aa1de None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:21.154983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b36f-4753-47c6-80ea-f8862b9aa1de None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:21.154983 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b36f-4753-47c6-80ea-f8862b9aa1de None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:21.156324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 712/1410] 10.222.0.45 () {54 vars in 918 bytes} [Fri Aug 19 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:21.162116 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646469fb-16d8-4abf-a55f-5320788a96a9 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:21.162521 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646469fb-16d8-4abf-a55f-5320788a96a9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:21.162699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646469fb-16d8-4abf-a55f-5320788a96a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:21.238324 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-646469fb-16d8-4abf-a55f-5320788a96a9 None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:21.239581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-646469fb-16d8-4abf-a55f-5320788a96a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:21.344651 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 699/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 19 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:21.358875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027469e-a3bd-4d65-9f0f-7937cf0436b7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:21.359162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027469e-a3bd-4d65-9f0f-7937cf0436b7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:21.359438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027469e-a3bd-4d65-9f0f-7937cf0436b7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:21.360757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 713/1412] 10.222.0.45 () {54 vars in 918 bytes} [Fri Aug 19 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:21.365420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d84f-c1ed-4082-a164-9df3446f31c9 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:21.365714 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d84f-c1ed-4082-a164-9df3446f31c9 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:21.365993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d84f-c1ed-4082-a164-9df3446f31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:21.437029 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:21.439646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a997d84f-c1ed-4082-a164-9df3446f31c9 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:21.441374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a997d84f-c1ed-4082-a164-9df3446f31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:21.553424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 700/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 19 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:23.907261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:23.907821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:23.907918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:23.909263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:23.914410 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c185b-45f7-487e-9ffe-481114337ed2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:23.914839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c185b-45f7-487e-9ffe-481114337ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:23.915007 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c185b-45f7-487e-9ffe-481114337ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:23.980744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-657c185b-45f7-487e-9ffe-481114337ed2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:23.981953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-657c185b-45f7-487e-9ffe-481114337ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:24.036440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:24.077922 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:24.363386 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:24.364919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:24.507663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e61bd-f581-4dc6-becc-da58cacb95ce None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:24.581433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:24.622315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:24.622958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:24.623239 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:24.623509 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:24.625096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:24.711897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:24.713469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fc681-a00f-4f7a-95c3-0d1c2f82c81c service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:24.730867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 715/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:25.614224 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:25.614781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:25.614781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:25.616092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:25.621069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9da77-db85-4427-800f-3b1c4f387ccb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:25.621479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9da77-db85-4427-800f-3b1c4f387ccb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:25.621628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9da77-db85-4427-800f-3b1c4f387ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:25.695634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-21a9da77-db85-4427-800f-3b1c4f387ccb None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:25.696841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-21a9da77-db85-4427-800f-3b1c4f387ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:25.724309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:25.792674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:25.940552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:25.942615 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:26.204438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da2317-c410-44fc-8cf1-e045dbe1f8ad None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:26.244216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:26.316017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:26.317238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:26.317511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:26.317779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:26.319376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:26.405411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:26.407002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9477-5e20-4e15-bb81-84d705788dec service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:26.424223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 703/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:27.299964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:27.300528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:27.300528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:27.301887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:27.306773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005907e-e780-4ca3-b449-1a12f09d1479 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:27.307201 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005907e-e780-4ca3-b449-1a12f09d1479 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:27.307319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005907e-e780-4ca3-b449-1a12f09d1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:27.360387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:27.383269 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-9005907e-e780-4ca3-b449-1a12f09d1479 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:27.384451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9005907e-e780-4ca3-b449-1a12f09d1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:27.478657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:27.627461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:27.629520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:27.772749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b8d3e-1f2f-443b-b5f7-c18a213c5723 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:27.784384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:27.881924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:27.882517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:27.882825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:27.883090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:27.884653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:27.971316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:27.972893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a8e27-353f-4d34-9f0a-30e7153b0d56 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:27.990749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 718/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:28.856663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:28.857198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:28.857198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:28.858588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:28.863583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2845cf-5f2d-4a22-a733-615228da7b95 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:28.864023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2845cf-5f2d-4a22-a733-615228da7b95 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:28.864119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2845cf-5f2d-4a22-a733-615228da7b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:28.883724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:28.937434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8a2845cf-5f2d-4a22-a733-615228da7b95 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:28.938551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8a2845cf-5f2d-4a22-a733-615228da7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:29.034181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:29.183648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:29.185156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:29.291909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:29.327484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683090f-563c-4f12-bcdc-3ce132516d69 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:29.436544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:29.437147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:29.437427 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:29.437701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:29.439309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:29.513105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:29.527136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:29.529513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798a9f8-5761-413b-b98c-cbd4ac23a522 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:29.551739 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 706/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:30.406795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:30.407383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:30.407383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:30.408687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:30.413575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60da0-e665-44f4-9801-834acb0c6732 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:30.414030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60da0-e665-44f4-9801-834acb0c6732 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:30.414143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60da0-e665-44f4-9801-834acb0c6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:30.488804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3cf60da0-e665-44f4-9801-834acb0c6732 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:30.489916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3cf60da0-e665-44f4-9801-834acb0c6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:30.584968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:30.735878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:30.737420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:30.819885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:30.879774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f03c-7b64-4969-9444-57290dc3d3ac None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:30.987847 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:30.988936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:30.989215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:30.989488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:30.991086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:31.037954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:31.077973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:31.079516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed276311-63de-42d7-b5e6-e61f3bab7c42 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:31.097845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 721/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:31.904065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:31.904614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:31.904614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:31.905940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:31.910965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9bf0-fa76-424b-a1f7-c3bcb4004935 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:31.911415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9bf0-fa76-424b-a1f7-c3bcb4004935 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:31.911512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9bf0-fa76-424b-a1f7-c3bcb4004935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:31.985549 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9d6b9bf0-fa76-424b-a1f7-c3bcb4004935 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:31.986792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9d6b9bf0-fa76-424b-a1f7-c3bcb4004935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:32.082464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:32.230731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:32.232236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:32.280619 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:32.385229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7baf92-a495-4232-aa52-ddc0581fb86d None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:32.496048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:32.496577 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:32.496851 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:32.497120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:32.498731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:32.506126 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:32.586052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:32.587671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82b712-bc60-4b53-83c4-4cb0a990eeec service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:32.606426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 709/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:33.407755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:33.408335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:33.408335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:33.409607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:33.414436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab8b9-9ea2-4f04-9c53-220dd7f867f1 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:33.414887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab8b9-9ea2-4f04-9c53-220dd7f867f1 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:33.415000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab8b9-9ea2-4f04-9c53-220dd7f867f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:33.488614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-745ab8b9-9ea2-4f04-9c53-220dd7f867f1 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:33.489723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-745ab8b9-9ea2-4f04-9c53-220dd7f867f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:33.555001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:33.585049 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:33.734216 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:33.735757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:33.754143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:33.879275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28b9f9-c9af-4682-b337-3bb0df74dd3d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:33.964750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:33.990584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:33.991198 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:33.991480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:33.991748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:33.993337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:34.079947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:34.081461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8af37-782a-4082-9948-0fea46718ca0 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:34.099998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 724/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:34.901265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:34.901699 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:34.901802 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:34.903186 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:34.907985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e52df-04fc-4bd1-917b-dc382df69e6a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:34.908407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e52df-04fc-4bd1-917b-dc382df69e6a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:34.908572 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e52df-04fc-4bd1-917b-dc382df69e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:34.982813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-700e52df-04fc-4bd1-917b-dc382df69e6a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:34.984015 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-700e52df-04fc-4bd1-917b-dc382df69e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:35.025469 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:35.078612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:35.228450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:35.229997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:35.372610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41bea-562e-4b0f-8126-3c6f36c9cf19 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:35.424187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:35.482411 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:35.482972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:35.483252 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:35.483529 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:35.485096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:35.572655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:35.574520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355012b3-1faf-4bf6-866b-155f5f946699 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:35.593317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 712/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:36.403489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:36.404042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:36.404042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:36.405418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:36.410399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d918ef-e18c-4ab2-a0e2-00adfe1d92dc None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:36.410872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d918ef-e18c-4ab2-a0e2-00adfe1d92dc None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:36.410988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d918ef-e18c-4ab2-a0e2-00adfe1d92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:36.486530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-e8d918ef-e18c-4ab2-a0e2-00adfe1d92dc None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:36.487833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e8d918ef-e18c-4ab2-a0e2-00adfe1d92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:36.489822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:36.584227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:36.732872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:36.734314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:36.874257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b972-e469-4201-bbc6-0de530c494d7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:36.900664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:36.984824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:36.985389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:36.985666 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:36.985939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:36.987554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:37.075128 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:37.076752 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b009-25fa-4ea7-997f-4a9beb36f3c7 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:37.094672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 727/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:38.893951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:38.894392 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:38.894491 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:38.895918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:38.901057 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f481-7287-46d3-b4c1-ea374ac0ead3 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:38.901430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f481-7287-46d3-b4c1-ea374ac0ead3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:38.901602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f481-7287-46d3-b4c1-ea374ac0ead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:38.942500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:38.967554 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6961f481-7287-46d3-b4c1-ea374ac0ead3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:38.968949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6961f481-7287-46d3-b4c1-ea374ac0ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:39.063261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:39.351379 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:39.352894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:39.452970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02ec3-16c6-4c03-bd0d-c9c9ca1c0338 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:39.484807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:39.525538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:39.526136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:39.526413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:39.526717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:39.528286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:39.634680 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:39.636125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7932161-4151-4992-ab04-975e4f63713a service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:39.654810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 715/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:41.681005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:41.681564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:41.681564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:41.682947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:41.688041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d797a-688d-4f10-814c-b899b4b187d3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:41.688440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d797a-688d-4f10-814c-b899b4b187d3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:41.688587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d797a-688d-4f10-814c-b899b4b187d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:41.753415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-da1d797a-688d-4f10-814c-b899b4b187d3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:41.754648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-da1d797a-688d-4f10-814c-b899b4b187d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:41.767069 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:41.850759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:42.136045 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:42.137571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:42.239046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24fc49-f541-4273-be06-21edffd48f15 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:42.250761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:42.310925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:42.311517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:42.311793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:42.312058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:42.313623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:42.417907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:42.419298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c3cb-d2e0-4b1a-894d-d7821feb6fd4 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:42.437052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 730/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:44.620106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:44.620667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:44.620667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:44.622022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:44.627251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430725c0-e16a-40d9-9464-fa93c350ac4c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:44.627679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430725c0-e16a-40d9-9464-fa93c350ac4c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:44.627794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430725c0-e16a-40d9-9464-fa93c350ac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:44.675474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:44.692951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-430725c0-e16a-40d9-9464-fa93c350ac4c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:44.694148 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-430725c0-e16a-40d9-9464-fa93c350ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:44.787206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:18:45.070835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:45.072356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:45.174452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4c52-2e91-4350-a619-0f9869f28885 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:45.214226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:45.247998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:45.248598 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:45.248870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:45.249134 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:45.250746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:45.356733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:45.358194 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2e120-802c-4455-80b5-e2ec297e8685 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:45.376515 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 718/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:47.380182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:47.380746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:47.380746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:47.382066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:47.387374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314ffe-c3a5-46ca-b638-76d29d92439f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:47.387817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314ffe-c3a5-46ca-b638-76d29d92439f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:47.387931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314ffe-c3a5-46ca-b638-76d29d92439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:47.452896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8b314ffe-c3a5-46ca-b638-76d29d92439f None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:47.454030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8b314ffe-c3a5-46ca-b638-76d29d92439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:47.474464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:47.551314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:47.834873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:47.836419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:47.940528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d9eb1-9719-4b6a-96c6-13b263e8ce21 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:47.960114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:48.012767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:48.013369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:48.013647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:48.013920 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:48.015536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:48.121558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:48.122985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595932f5-c0d1-43a5-86d8-dc17296ab3c6 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:48.141210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 733/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:50.092524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:50.093366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:50.093366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:50.094720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:50.100459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72b97-e22e-446c-95da-affe79f5b9c0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:50.100903 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72b97-e22e-446c-95da-affe79f5b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:50.101030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72b97-e22e-446c-95da-affe79f5b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:50.163264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:50.170671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4ea72b97-e22e-446c-95da-affe79f5b9c0 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:50.172412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4ea72b97-e22e-446c-95da-affe79f5b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:50.266629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:50.549437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:50.551030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:50.658003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678db1-9c0e-401a-8d52-e71a57ba3764 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:50.707682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:50.732791 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:50.733399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:50.733677 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:50.733944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:50.735558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:50.845384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:50.846773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146a2af-8119-4f61-99ef-184905abfdc2 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:50.864779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 721/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:52.885859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:52.886283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:52.886416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:52.887834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:52.893106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd493e0-ca41-49f5-8076-9143dcd1c896 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:52.894135 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd493e0-ca41-49f5-8076-9143dcd1c896 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:52.894254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd493e0-ca41-49f5-8076-9143dcd1c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:52.957873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-cbd493e0-ca41-49f5-8076-9143dcd1c896 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:52.959096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-cbd493e0-ca41-49f5-8076-9143dcd1c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:52.987304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:53.052905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:53.335519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:53.337082 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:53.441096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d118d95-b877-4b44-a28b-96fe67d0cd32 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:53.468790 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:53.513353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:53.513947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:53.514223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:53.514494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:53.516105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:53.621294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:53.622749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039fe2-9316-44e1-b8db-396ce9d087ca service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:53.640654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 736/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:55.561119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:55.561638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:55.561638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:55.563055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:55.569001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b226f-aa61-4984-9735-9e0985253aeb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:55.569407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b226f-aa61-4984-9735-9e0985253aeb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:55.569588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b226f-aa61-4984-9735-9e0985253aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:55.634736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-aa6b226f-aa61-4984-9735-9e0985253aeb None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:55.635934 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-aa6b226f-aa61-4984-9735-9e0985253aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:55.644499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:55.731164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:56.011949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:56.013478 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:56.115885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1aea-79e9-48ef-9333-c3a28ae024bf None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:56.169466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:56.187819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:56.188417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:56.188690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:56.189031 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:56.191197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:56.296415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:56.297758 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9530-cd87-4958-afb1-50eacb18892d service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:56.316663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 724/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:18:58.245019 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:58.245558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:58.245558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:58.246948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:18:58.252123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7df91-206c-4455-a359-e769777599f2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:58.252683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7df91-206c-4455-a359-e769777599f2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:58.252683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7df91-206c-4455-a359-e769777599f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:58.317745 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-c9f7df91-206c-4455-a359-e769777599f2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:18:58.319017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-c9f7df91-206c-4455-a359-e769777599f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:58.359272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:58.416749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:18:58.702664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:18:58.704207 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:58.807144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ae29-bcb3-4845-9d5f-3b3cbe75a4a7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:18:58.844296 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:18:58.879309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:18:58.879911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:18:58.880191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:18:58.880459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:18:58.882042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:18:58.989298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:18:58.990685 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca35dc-c6a8-4eba-9548-5c1101e6e5c6 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:18:59.008986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 739/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:00.898861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:00.899348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:00.899448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:00.900821 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:00.906036 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36529419-7187-48fd-852a-fa286ffe784d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:00.906466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36529419-7187-48fd-852a-fa286ffe784d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:00.906628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36529419-7187-48fd-852a-fa286ffe784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:00.972397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-36529419-7187-48fd-852a-fa286ffe784d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:00.973638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-36529419-7187-48fd-852a-fa286ffe784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:00.991784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:01.069474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:01.351265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:01.352817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:01.454061 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594226-e842-42f0-9684-0541e633c6dc None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:01.520302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:01.527672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:01.528271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:01.528546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:01.528814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:01.530373 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:01.636172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:01.637859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf0ff-1f9c-49c0-824b-45d1b8c6bc44 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:01.655557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 727/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:03.571389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:03.572006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:03.572006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:03.573200 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:03.578528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b05a0d-62e8-4282-9c07-ec424025708a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:03.579000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b05a0d-62e8-4282-9c07-ec424025708a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:03.579103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b05a0d-62e8-4282-9c07-ec424025708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:03.644087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-56b05a0d-62e8-4282-9c07-ec424025708a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:03.645268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-56b05a0d-62e8-4282-9c07-ec424025708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:03.692012 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:03.740183 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:04.020402 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:04.021916 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:04.121340 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9ac9-c463-438e-a85f-2018c5a32720 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:04.169217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:04.195231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:04.195841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:04.196120 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:04.196397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:04.197984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:04.305982 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:04.307507 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b2bea-47db-4960-8674-9d4e0862f7a5 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:04.325629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 742/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:13.738353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=22 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:14.323368 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=66 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:23.556278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fad4d-bdf0-401e-b35b-a42fa7b38f0c None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:23.556827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fad4d-bdf0-401e-b35b-a42fa7b38f0c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:23.556827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fad4d-bdf0-401e-b35b-a42fa7b38f0c None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:23.558119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 729/1471] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:23.563504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bd4e-da04-4db0-96b3-31f68dfb7d77 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:23.564466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bd4e-da04-4db0-96b3-31f68dfb7d77 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:23.564681 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1bd4e-da04-4db0-96b3-31f68dfb7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:23.630875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ecc1bd4e-da04-4db0-96b3-31f68dfb7d77 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:23.632086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ecc1bd4e-da04-4db0-96b3-31f68dfb7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:23.726930 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 743/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:24.021989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:24.022279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:24.022553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:24.023933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 730/1473] 10.222.0.45 () {54 vars in 967 bytes} [Fri Aug 19 02:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:24.028706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d437-b83f-4a78-b1a6-fee02c5f7733 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:24.028997 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d437-b83f-4a78-b1a6-fee02c5f7733 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:24.029271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d437-b83f-4a78-b1a6-fee02c5f7733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:24.103230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ea88d437-b83f-4a78-b1a6-fee02c5f7733 None None] MFA Rules not processed for user `18fe513fdeb442c6bbd2e2144169ba78`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:24.104433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ea88d437-b83f-4a78-b1a6-fee02c5f7733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:24.124534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:24.180558 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 744/1474] 10.222.0.45 () {58 vars in 1064 bytes} [Fri Aug 19 02:19:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:24.188345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:24.190353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:24.290958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21298c8e-55da-4bc9-a202-2a8272590870 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:24.362046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe513fdeb442c6bbd2e2144169ba78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:24.362670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:24.362953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:24.363226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:24.364789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:24.417776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:24.471807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:24.473229 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9471-d695-4b64-9bf3-0db6b6b9ba94 service glance] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:24.491722 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 731/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:26.445004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:26.445547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:26.445547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:26.446830 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 745/1476] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:26.452083 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adff4-8577-410e-b697-8fcff7119ce3 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:26.452490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adff4-8577-410e-b697-8fcff7119ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:26.452635 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adff4-8577-410e-b697-8fcff7119ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:26.518712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-403adff4-8577-410e-b697-8fcff7119ce3 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:26.519913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-403adff4-8577-410e-b697-8fcff7119ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:26.614351 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 732/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:19:26.882063 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:26.883704 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:27.009042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641853a-a65f-44a9-bb7b-45fb90f2b422 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:27.056081 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:27.101136 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:27.101748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:27.102026 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:27.102295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:27.102958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:27.104664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:19:27.104664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:19:27.104664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:19:27.105801 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2e975-5a8a-4f4c-9ef3-bb5bf2d3b425 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:27.124360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 746/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 19 02:19:26 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:19:29.022465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:29.023062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:29.023062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:29.024395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 733/1479] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:29.029710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed544f-4423-4d5a-a83d-adfe514935fe None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:29.030109 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed544f-4423-4d5a-a83d-adfe514935fe None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:29.030293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed544f-4423-4d5a-a83d-adfe514935fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:29.094316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-01ed544f-4423-4d5a-a83d-adfe514935fe None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:29.095601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-01ed544f-4423-4d5a-a83d-adfe514935fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:29.191065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 747/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:29.480942 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:29.482528 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:29.493088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:29.626042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fcd6-ddff-409b-9266-34593ae064a7 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:29.703976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:29.736913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:29.737445 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:29.737720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:29.737987 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:29.739597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:29.825819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:29.827417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e10a-106c-4f5c-a47b-2b72866f02c5 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:29.845864 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 734/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:31.915744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:31.916317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:31.916317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:31.917636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 748/1482] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:31.923470 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bb6a-5b05-40df-8001-dbc92e73500b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:31.923884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bb6a-5b05-40df-8001-dbc92e73500b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:31.924021 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bb6a-5b05-40df-8001-dbc92e73500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:31.988854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-2da8bb6a-5b05-40df-8001-dbc92e73500b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:31.990047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-2da8bb6a-5b05-40df-8001-dbc92e73500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:32.035006 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:32.084581 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 735/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:32.377512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:32.379107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:32.401939 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:32.480628 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722b2a-c049-4dda-aa7b-b46cb5cab3b2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:32.552759 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:32.553359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:32.553638 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:32.553909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:32.555508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:32.629909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:32.665761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:32.667221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285b87-272d-4172-96d8-48d2e15b6a26 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:32.685037 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 749/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:34.619316 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:34.619899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:34.619899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:34.621288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 736/1485] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:34.626941 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4475-d2bd-4b93-af61-a491e7b2a911 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:34.627417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4475-d2bd-4b93-af61-a491e7b2a911 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:34.627546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4475-d2bd-4b93-af61-a491e7b2a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:34.691856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9edf4475-d2bd-4b93-af61-a491e7b2a911 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:34.693051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9edf4475-d2bd-4b93-af61-a491e7b2a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:34.787578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 750/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:35.071072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:35.072665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:35.175620 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9ca70-077e-42ef-846a-e62ddd18ba0a None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:35.246441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:35.248233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:35.248849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:35.249322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:35.249792 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:35.251593 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:35.358389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:35.359776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1185-f1db-433f-abed-8ffde6cf432b service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:35.378214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 737/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:37.342446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:37.343306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:37.343306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:37.345193 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 751/1488] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:37.350448 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d751-103e-49a8-8948-32745749d21c None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:37.350884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d751-103e-49a8-8948-32745749d21c None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:37.351023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d751-103e-49a8-8948-32745749d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:37.416142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-1416d751-103e-49a8-8948-32745749d21c None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:37.417330 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1416d751-103e-49a8-8948-32745749d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:37.468276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:37.510933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 738/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:37.800874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:37.802413 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:37.838119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:37.905479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac936ac-0325-4267-83f4-658ab59536d1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:37.981254 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:37.981866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:37.982145 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:37.982417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:37.984051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:38.061728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:38.090835 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:38.092257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b40ed9-4665-4085-9dfb-739fbdbd1cee service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:38.110958 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 752/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:19:40.164091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:40.164659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:40.164659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:40.165995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 739/1491] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 19 02:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:19:40.171293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46a887-e4be-483f-9c47-38b85d45a3b8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:40.171696 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46a887-e4be-483f-9c47-38b85d45a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:40.171852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46a887-e4be-483f-9c47-38b85d45a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:40.236385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2c46a887-e4be-483f-9c47-38b85d45a3b8 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:19:40.237590 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2c46a887-e4be-483f-9c47-38b85d45a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:40.330819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 753/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 19 02:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:19:40.619725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:19:40.621234 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:40.723265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f86a-f23a-4bab-8aa3-c605c4b28d52 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:19:40.793578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:19:40.794172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:19:40.794449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:19:40.794748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:19:40.796293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:19:40.805164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:40.902059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:19:40.903514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36273df-4f9e-4272-a1bd-c14aab011baa service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:19:40.921617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 740/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:19:50.328460 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=82 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:19:50.919361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=50 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:05.057720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:05.058258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:05.058258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:05.131433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:21:05.132617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:05.228789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 754/1494] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:21:05.236753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:05.237222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:05.237333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:05.312784 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:21:05.313971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:05.408885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 741/1495] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:21:05.413514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:05.414772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:05.425859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053def-e905-44ba-b3e1-bad56581cc17 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:05.485474 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:05.519177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:05.519782 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:05.520059 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:05.520329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:05.520964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:21:05.521264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:05.522263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:05.522263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:21:05.522263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:21:05.523177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:05.534407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 755/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 19 02:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:21:05.542896 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:05.552582 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fc93c-7fda-4e34-97fd-6065caffc051 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:05.612395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:05.650744 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:05.651345 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:05.651623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:05.651893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:05.652513 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:05.654859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:05.654859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:21:05.654859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:21:05.656056 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:05.709404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 742/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 19 02:21:05 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:21:05.713726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:05.715334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:05.748463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f46e5-57c1-455c-9e48-fec078237661 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:05.840609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:05.841206 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:05.842050 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:05.842334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:05.843237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:05.844230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:05.844230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:21:05.844230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:21:05.845432 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:05.886226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 756/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:21:05 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:21:05.890298 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:05.891849 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:05.953169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd6a-0eef-4979-9ebc-72b3e9321e5d admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:06.034171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:06.045066 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:06.045671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.045947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.046215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.046890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:06.047898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:06.047898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:21:06.047898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:21:06.048777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:06.061546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 743/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:21:06.065655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:06.067192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.079115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c197046-1f8d-4524-81b1-d6e986f7558a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:06.105519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:06.174756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:06.175438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.175717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.175984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.176613 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:06.177605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:06.177605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:21:06.177605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:21:06.178481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cc122-6f6d-4b4d-912d-22405c326867 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:06.191485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 757/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:21:06.195860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:06.197399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.230384 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1ff6-0008-4e06-979b-520c998ec24a admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:06.323337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:06.323974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.324178 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.324446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] PATH_INFO: `/v3/projects/b0ba5d95f5de466498899acf39a6b694/users/cd53faaa598549619400ad0e98dd0508/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.347571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ba5d95f5de466498899acf39a6b694, user_id=cd53faaa598549619400ad0e98dd0508, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:06.348580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:06.348580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:21:06.348580 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:21:06.350487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe29c1-e670-4d84-a1e1-b6e7d2e3d333 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:06.375176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 744/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:21:06 2022] PUT /identity/v3/projects/b0ba5d95f5de466498899acf39a6b694/users/cd53faaa598549619400ad0e98dd0508/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:21:06.387124 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f49c-60b9-4c26-850f-5d7ea45dba7f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.387434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f49c-60b9-4c26-850f-5d7ea45dba7f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.387711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f49c-60b9-4c26-850f-5d7ea45dba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.446584 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e1f4f49c-60b9-4c26-850f-5d7ea45dba7f None None] MFA Rules not processed for user `cd53faaa598549619400ad0e98dd0508`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:21:06.447780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e1f4f49c-60b9-4c26-850f-5d7ea45dba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.525873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 758/1502] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:21:06.540357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.540644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.540921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.542271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 745/1503] 10.222.0.45 () {54 vars in 964 bytes} [Fri Aug 19 02:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:21:06.546994 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb20bf-7dde-4de6-bdd1-6b7aaea69082 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.547282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb20bf-7dde-4de6-bdd1-6b7aaea69082 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.547557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb20bf-7dde-4de6-bdd1-6b7aaea69082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.578093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:06.623184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d2bb20bf-7dde-4de6-bdd1-6b7aaea69082 None None] MFA Rules not processed for user `fae1e43e357649ceb0e7d0e6f0c0c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:21:06.624380 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d2bb20bf-7dde-4de6-bdd1-6b7aaea69082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.699129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 759/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Aug 19 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:21:06.707435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:06.709041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.761163 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:06.814162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc414a1-e477-49db-b768-7e415ef2762e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:06.884024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae1e43e357649ceb0e7d0e6f0c0c0ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:06.884616 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:06.884893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:06.885162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:06.886749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:06.983434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:06.984898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:06.988366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:07.003660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 746/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:21:07.048646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317846d9-08cc-44ff-bd91-942a1a0d316d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:07.048933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317846d9-08cc-44ff-bd91-942a1a0d316d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:07.049213 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317846d9-08cc-44ff-bd91-942a1a0d316d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:07.050464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 760/1506] 10.222.0.45 () {52 vars in 830 bytes} [Fri Aug 19 02:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:21:07.054107 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:07.055383 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:07.152249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545bde-4151-4b1c-a9fe-00b53b4a935d service cinder] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:07.244575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:07.245197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:07.245473 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:07.245746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] PATH_INFO: `/v3/users/cd53faaa598549619400ad0e98dd0508` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:07.257799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd53faaa598549619400ad0e98dd0508)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:07.258840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:07.258840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:21:07.258840 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:21:07.260052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:07.270088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:07.324130 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd53faaa598549619400ad0e98dd0508'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:07.333966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd53faaa598549619400ad0e98dd0508'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:07.334480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd53faaa598549619400ad0e98dd0508'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:07.334978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd53faaa598549619400ad0e98dd0508'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:07.349228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd53faaa598549619400ad0e98dd0508'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:07.376159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 747/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 19 02:21:07 2022] DELETE /identity/v3/users/cd53faaa598549619400ad0e98dd0508 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:21:07.380505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:07.380978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:07.381088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:07.437657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:21:07.438812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:07.511284 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:07.524297 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 761/1508] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:21:07.534388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:07.535674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:07.640422 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9530-e093-4558-a4e7-0c4c5e703c65 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:07.693872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:07.713488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:07.714092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:07.714370 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:07.714675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:07.716243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:07.821034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:07.822467 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271000d-b366-4645-b66c-83ba306bcc04 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:07.843907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 748/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:21:08.182725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:21:08.183948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:21:08.196060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86877de-872f-45c7-9aa9-0a8bcd0a276a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:21:08.295508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:21:08.296139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:21:08.296416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:21:08.296686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] PATH_INFO: `/v3/projects/b0ba5d95f5de466498899acf39a6b694` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:21:08.307514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ba5d95f5de466498899acf39a6b694)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:21:08.308517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:21:08.308517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:21:08.308517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:21:08.309702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:21:08.365900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ba5d95f5de466498899acf39a6b694', 'request_id': 'req-2ba615ad-1b62-4ce4-b19e-e212331516d5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:08.376236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ba5d95f5de466498899acf39a6b694', 'request_id': 'req-2ba615ad-1b62-4ce4-b19e-e212331516d5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:08.382314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ba5d95f5de466498899acf39a6b694', 'request_id': 'req-2ba615ad-1b62-4ce4-b19e-e212331516d5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:08.411703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] The token cache is being invalidate because project b0ba5d95f5de466498899acf39a6b694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:21:08.411993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:08.412510 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2ba615ad-1b62-4ce4-b19e-e212331516d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:21:08.413829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 762/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 19 02:21:08 2022] DELETE /identity/v3/projects/b0ba5d95f5de466498899acf39a6b694 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:21:17.840723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=62 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:21:18.409738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:22:22.690850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:22.691437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:22.691437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:22.692765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:22.697452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f631-eac1-4cab-9c37-52de58c71b90 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:22.697873 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f631-eac1-4cab-9c37-52de58c71b90 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:22.698004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2f631-eac1-4cab-9c37-52de58c71b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:22.776188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dfc2f631-eac1-4cab-9c37-52de58c71b90 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:22.777885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dfc2f631-eac1-4cab-9c37-52de58c71b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:22.879293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:23.032555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:23.034692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:23.155481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496783c-1031-478c-b27a-acafbaa69b6e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:23.160932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:23.161536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:23.161814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:23.162087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:23.169932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:23.171608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e92cdc-ef1e-41ce-a152-8ef8a5367c4e service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:23.180712 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 750/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:24.003333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4893-f6df-4edd-ab42-504c95b8791b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:24.003860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4893-f6df-4edd-ab42-504c95b8791b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:24.003993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4893-f6df-4edd-ab42-504c95b8791b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:24.005247 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:24.010017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6c6a-0aa4-4800-bd9d-e59cdfd99a40 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:24.010455 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6c6a-0aa4-4800-bd9d-e59cdfd99a40 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:24.010561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6c6a-0aa4-4800-bd9d-e59cdfd99a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:24.031108 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-68ab6c6a-0aa4-4800-bd9d-e59cdfd99a40 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:24.032321 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-68ab6c6a-0aa4-4800-bd9d-e59cdfd99a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:24.040233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:24.191223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4893-f6df-4edd-ab42-504c95b8791b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:24.205223 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4893-f6df-4edd-ab42-504c95b8791b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:24.210687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:24.211277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:24.211553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:24.211826 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:24.220397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:24.221968 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57271128-effb-496c-bfe4-76ac02a41f66 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:24.231599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 765/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:27.568233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722bcc-b9d4-499e-abbd-3dbe2afa8ad2 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:27.568764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722bcc-b9d4-499e-abbd-3dbe2afa8ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:27.568764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722bcc-b9d4-499e-abbd-3dbe2afa8ad2 None None] PATH_INFO: `/v3` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:27.570008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 752/1517] 10.222.0.64 () {54 vars in 925 bytes} [Fri Aug 19 02:22:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:22:27.576657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f43b-5869-46aa-be61-1b031902193d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:27.577095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f43b-5869-46aa-be61-1b031902193d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:27.577210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f43b-5869-46aa-be61-1b031902193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:27.635492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8ef6f43b-5869-46aa-be61-1b031902193d None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:27.636669 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8ef6f43b-5869-46aa-be61-1b031902193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:27.652816 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:22:27.708034 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 766/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Aug 19 02:22:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:31.551753 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03226f-003d-4542-9d85-ad2be34c82bb None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:31.552279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03226f-003d-4542-9d85-ad2be34c82bb None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:31.552279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03226f-003d-4542-9d85-ad2be34c82bb None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:31.553629 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 753/1519] 10.222.0.45 () {54 vars in 961 bytes} [Fri Aug 19 02:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 02:22:31.559306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e0b5-562b-4e8b-9c35-fced69d465af None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:31.559738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e0b5-562b-4e8b-9c35-fced69d465af None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:31.559845 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e0b5-562b-4e8b-9c35-fced69d465af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:31.579313 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8ed9e0b5-562b-4e8b-9c35-fced69d465af None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:31.580501 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8ed9e0b5-562b-4e8b-9c35-fced69d465af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:31.588879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 767/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Aug 19 02:22:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:31.596435 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03226f-003d-4542-9d85-ad2be34c82bb None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:31.609785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03226f-003d-4542-9d85-ad2be34c82bb None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:31.614657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:31.615244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:31.615527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:31.615804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:31.624419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:31.625993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b354a9-b4f4-4cd1-9daa-1f97aa8371bd service placement] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:31.635508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 754/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:35.437441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff308d-a082-4afd-a82e-bc70803990d7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:35.438000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff308d-a082-4afd-a82e-bc70803990d7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:35.438000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff308d-a082-4afd-a82e-bc70803990d7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:35.439397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:35.444226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278d3-bb93-47b0-ab47-6c97e5c9e4d2 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:35.444624 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278d3-bb93-47b0-ab47-6c97e5c9e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:35.444781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487278d3-bb93-47b0-ab47-6c97e5c9e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:35.463545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-487278d3-bb93-47b0-ab47-6c97e5c9e4d2 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:35.465261 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-487278d3-bb93-47b0-ab47-6c97e5c9e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:35.473512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:35.625949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff308d-a082-4afd-a82e-bc70803990d7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:35.640825 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff308d-a082-4afd-a82e-bc70803990d7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:35.646100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:35.646723 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:35.647002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:35.647272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:35.655587 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:35.657139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf6601-557c-4598-9244-d9f1538629ec service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:35.666199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 769/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:36.481489 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba1b3-f017-423c-935e-2a3471d52942 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:36.482014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba1b3-f017-423c-935e-2a3471d52942 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:36.482014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ba1b3-f017-423c-935e-2a3471d52942 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:36.483652 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 02:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:36.488683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683ed7-f881-4b76-9a23-c8122306a590 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:36.489122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683ed7-f881-4b76-9a23-c8122306a590 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:36.489219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683ed7-f881-4b76-9a23-c8122306a590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:36.508750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f3683ed7-f881-4b76-9a23-c8122306a590 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:36.509946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f3683ed7-f881-4b76-9a23-c8122306a590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:36.517836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 02:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:36.668046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ba1b3-f017-423c-935e-2a3471d52942 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:36.682268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ba1b3-f017-423c-935e-2a3471d52942 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:36.688458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:36.689052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:36.689332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:36.689606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:36.697468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:36.699075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81ef55-66c9-4685-bcf8-68920ea56038 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:36.708282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 757/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:40.566798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:40.567359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:40.567359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:40.568602 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:40.573693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7a79a-602d-4571-bb9f-67f703889ca0 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:40.574157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7a79a-602d-4571-bb9f-67f703889ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:40.574262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7a79a-602d-4571-bb9f-67f703889ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:40.593874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-62c7a79a-602d-4571-bb9f-67f703889ca0 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:40.595356 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-62c7a79a-602d-4571-bb9f-67f703889ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:40.603111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:40.886911 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:40.888621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:40.965748 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76dbe4-02fb-4447-9b58-141ced10aebe None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:40.969540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:40.970141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:40.970438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:40.970788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:40.979418 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:40.980863 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c8b6-9ee5-4325-a996-b35c1a6e4042 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:40.989975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 772/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:42.869210 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:42.869781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:42.869781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:42.871665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:42.876730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4debd-0b1b-49fd-993d-cf8b631d16d7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:42.877170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4debd-0b1b-49fd-993d-cf8b631d16d7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:42.877271 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4debd-0b1b-49fd-993d-cf8b631d16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:42.896777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3ee4debd-0b1b-49fd-993d-cf8b631d16d7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:42.897976 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3ee4debd-0b1b-49fd-993d-cf8b631d16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:42.905701 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:43.194030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:43.195725 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:43.208450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b1b82-ab57-4021-8285-40d2790cef80 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:43.211878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:43.212461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:43.212737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:43.213009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:43.221848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:43.223275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad18cc-64e8-4f0b-aca6-aadf574992df service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:43.232874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 760/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:46.604147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:46.605235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:46.605235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:46.606610 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:46.612051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87117-1cf9-47f7-9df1-65755158595b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:46.612539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87117-1cf9-47f7-9df1-65755158595b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:46.612647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87117-1cf9-47f7-9df1-65755158595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:46.634079 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-99e87117-1cf9-47f7-9df1-65755158595b None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:46.635426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-99e87117-1cf9-47f7-9df1-65755158595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:46.644192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:47.186809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:47.188522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:47.252573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:22:47.267905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaa39-8514-4778-9cd5-4f80fc51b99f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:47.271446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae1e43e357649ceb0e7d0e6f0c0c0ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:47.272052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:47.272332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:47.272606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:47.281954 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:47.283404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba24db-3fe1-493d-b9f2-bf99656b6caa service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:47.293154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 775/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:49.207781 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:49.208290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:49.208399 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:49.209668 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 02:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:22:49.215306 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007935-29a3-4275-ad94-64cfc185e08d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:49.215709 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007935-29a3-4275-ad94-64cfc185e08d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:49.215853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007935-29a3-4275-ad94-64cfc185e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:49.235690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d8007935-29a3-4275-ad94-64cfc185e08d None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:22:49.236887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d8007935-29a3-4275-ad94-64cfc185e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:49.244692 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 02:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:22:49.789963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:22:49.791707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:22:49.799805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=84 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:22:49.806440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0bdb1-bb10-4e64-8c58-0fefaaa00bf5 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:22:49.810522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae1e43e357649ceb0e7d0e6f0c0c0ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:22:49.811137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:22:49.811417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:22:49.811695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:22:49.820568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:22:49.821998 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e11533-9329-4e3a-8fa9-b23b48bc5cbc service cinder] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:22:49.831212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 763/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:22:59.230795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=11 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:22:59.827172 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=5 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:06.834633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7c3d-5308-4d5b-9dbd-52c136dfc8b7 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.835333 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2ce5-13e3-4c19-a561-ffff1fcbfdcb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.835728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7c3d-5308-4d5b-9dbd-52c136dfc8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.835834 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2ce5-13e3-4c19-a561-ffff1fcbfdcb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.835929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7c3d-5308-4d5b-9dbd-52c136dfc8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.836030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2ce5-13e3-4c19-a561-ffff1fcbfdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.854921 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9b5b2ce5-13e3-4c19-a561-ffff1fcbfdcb None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:06.855118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d46e7c3d-5308-4d5b-9dbd-52c136dfc8b7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:06.856125 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9b5b2ce5-13e3-4c19-a561-ffff1fcbfdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:06.856245 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d46e7c3d-5308-4d5b-9dbd-52c136dfc8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:06.864258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 777/1540] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:06.864398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 764/1541] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:06.872671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.872846 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.872946 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.873028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.873222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.873328 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.891950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:06.892332 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:06.893265 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:06.893488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:06.901563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 778/1542] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:06.901996 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 765/1543] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:06.906140 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:06.906274 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:06.915105 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c993-4a83-456a-9659-c70c9f203ec7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:06.916143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72cd7-7e66-46b6-9e90-0c13d7855f66 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:06.920222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:06.920679 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:06.920823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.921071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.921255 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.921372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.921539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.921809 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.921963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:24:06.922264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:06.922439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81528) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 02:24:06.922817 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:06.923811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:24:06.923811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:24:06.923811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:24:06.924051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:06.924683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:06.935901 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 779/1544] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 19 02:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:24:06.937897 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 766/1545] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 19 02:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 02:24:06.943729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:06.945654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:06.953618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbff9-4604-4c13-a2bb-826d91e18311 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:06.955238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10728d-da4e-4ae9-95a1-0710985e98ae admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:06.958221 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:06.958842 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.959122 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.959393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.959738 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:06.960002 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:06.960315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:06.960597 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:06.960870 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:06.960979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:24:06.960979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:24:06.960979 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:24:06.961484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:06.962732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:06.963919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:06.999217 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 780/1546] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:07.000626 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 767/1547] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 19 02:24:06 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:07.003196 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.004760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.066517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3d415-c69a-402f-84c1-33928f14105c admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.068539 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf8060-5685-4756-bbc6-0afb03c75bad admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.071115 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.071783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.072062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.072938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.073346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.073570 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.073948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.074348 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.074617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:24:07.074617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:24:07.074617 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:24:07.074860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.075268 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.075822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.077169 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.098479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 768/1548] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:24:07 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:07.105794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.105949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 781/1549] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:24:07 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:07.106852 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.112621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbcca4-7cdf-4f6e-a25d-c50cb9b0e481 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.116417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe87ea-8b31-45b6-8d85-05546f23189c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.117289 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.117878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.118176 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.118454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.119119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.120773 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.121184 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.121749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.122030 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.122303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.122970 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.124526 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.133767 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 769/1550] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:24:07.134583 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 782/1551] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:24:07.134888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.138440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.145197 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95010c39-a56c-4ef1-9801-26582815bf5b admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.147906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0034d-e658-4822-b6fd-ad16f7a76ba2 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.150794 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.151394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.151693 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.151975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.152600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.153264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.153856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.154132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.154236 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.154401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.155074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.156664 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.164636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 770/1552] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:24:07.172072 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 783/1553] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:24:07.172218 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.173586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.179440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8496a7-53ec-4b72-bbcd-e9cdc99639a4 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.183552 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05047e6-013b-4dd4-b3ee-64b5020f6d87 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.184487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.185141 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.185423 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.185694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] PATH_INFO: `/v3/projects/2796e836399045c18eff2a7ca9bee757/users/cd34454ce1de45feb4e0c18830babf58/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.188232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.188874 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.189150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.189424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] PATH_INFO: `/v3/projects/ab44209aebd34f57b24977b2b2559e15/users/7620799ff4574986a6a9819014b472be/roles/3a794b68c0934063ac3400ead0e17439` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.201017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2796e836399045c18eff2a7ca9bee757, user_id=cd34454ce1de45feb4e0c18830babf58, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.203603 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab44209aebd34f57b24977b2b2559e15, user_id=7620799ff4574986a6a9819014b472be, role_id=3a794b68c0934063ac3400ead0e17439)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.203721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa8efd-30f5-4e5a-9be5-d57c550291e6 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.204608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:24:07.204608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:24:07.204608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:24:07.206522 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b9fe-e9ba-4948-ab6f-f7bc661b6a33 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.217391 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 771/1554] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:07 2022] PUT /identity/v3/projects/2796e836399045c18eff2a7ca9bee757/users/cd34454ce1de45feb4e0c18830babf58/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:24:07.219369 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 784/1555] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:07 2022] PUT /identity/v3/projects/ab44209aebd34f57b24977b2b2559e15/users/7620799ff4574986a6a9819014b472be/roles/3a794b68c0934063ac3400ead0e17439 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:24:07.223419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.223419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.223419 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.224914 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.225203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.225498 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.241466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:07.242684 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:07.244235 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] MFA Rules not processed for user `b7e755f06a714e6f8be16f18f3592f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:07.245389 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:07.283720 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:07.285062 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:07.304299 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 785/1556] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:07.306645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 772/1557] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:07.314346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.314485 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:07.369329 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df946a-7234-4089-88f2-a87018b0ee65 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.369520 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3a46-e729-4876-812b-50f5eba2b7b0 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:07.372892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.373123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:07.373492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.373721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:07.373827 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.374003 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:07.374112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.374276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:07.382948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.383074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:07.384405 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe72a1-1c14-4c34-86c7-631e2bade1d7 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.384534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:07.393564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 786/1558] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:07.393935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 773/1559] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:12.229144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.230449 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.231024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.282139 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:12.283499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:12.393022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 787/1560] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:12.397347 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.410259 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583fc0-b01b-4e98-be84-cafad6507b21 service neutron] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.420401 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.421237 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.421534 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.421796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.422694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.432731 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.485199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 774/1561] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 19 02:24:12 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:24:12.489111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.524557 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d04d-d268-45c3-b78a-b0d271fc89a2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.626799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.627551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.627929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.628326 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.629180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.631426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.675503 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 788/1562] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:24:12 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 02:24:12.679585 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.694095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03e512-f925-47bf-8e16-25c98f51b691 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.701182 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.701923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.702606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.702606 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.703441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.705212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.723634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 775/1563] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:24:12.728192 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.741599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5437-940d-45ed-9874-d4ca58af73f9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.748465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.749431 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.749879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.750322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] PATH_INFO: `/v3/projects/c9707f12e109481094295fdf98a37b4e/users/b6778043d7984c4db2f045b3bfc83a7a/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.754458 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:12.772527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9707f12e109481094295fdf98a37b4e, user_id=b6778043d7984c4db2f045b3bfc83a7a, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.776487 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.797308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 789/1564] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:12 2022] PUT /identity/v3/projects/c9707f12e109481094295fdf98a37b4e/users/b6778043d7984c4db2f045b3bfc83a7a/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:24:12.801104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.814524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5b952-a6dc-4d99-a1a2-d7be4968f255 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.900856 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.901683 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.902277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.902656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.903533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.905568 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1698-fac1-42ee-b93b-4c8f89067c82 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.917674 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 776/1565] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:24:12.922729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:12.934263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.934653 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.935004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.941085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ff6c-d41e-4a51-85f8-654513ba2f7b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:12.946420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:12.947190 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:12.947546 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:12.947893 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] PATH_INFO: `/v3/projects/c9707f12e109481094295fdf98a37b4e/users/b6778043d7984c4db2f045b3bfc83a7a/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:12.949906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9707f12e109481094295fdf98a37b4e, user_id=b6778043d7984c4db2f045b3bfc83a7a, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:12.952735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:12.964353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 790/1566] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:12 2022] PUT /identity/v3/projects/c9707f12e109481094295fdf98a37b4e/users/b6778043d7984c4db2f045b3bfc83a7a/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:24:12.969374 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] MFA Rules not processed for user `7620799ff4574986a6a9819014b472be`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:12.970992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:13.024848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:13.057880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 777/1567] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:13.058729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.184022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e49392-8c8e-4050-9fdb-ddaeb1a84e24 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.192416 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.193164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.193548 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.193895 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.194633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.197673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.250363 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.259859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 791/1568] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 19 02:24:13 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:13.267233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1193b-df94-420a-9570-a4179515fc24 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.354575 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.354869 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.355188 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.355360 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] PATH_INFO: `/v3/users` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.356024 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.358650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.392272 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 778/1569] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 19 02:24:13 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 02:24:13.393838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.407366 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b083-9ad1-4e4f-8de1-e141bfb30373 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.418475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.418919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.419175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.419446 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.420099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.421963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.439308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 792/1570] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 02:24:13.440878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.456400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d4a2e-9c81-4109-984b-d2899f0ff13e admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.468068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.469282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.469671 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.470436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] PATH_INFO: `/v3/projects/dcb20bac668247669420d2d5a0130b4e/users/387a6ea6fa384a00a366d0d2071ba03a/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.491866 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb20bac668247669420d2d5a0130b4e, user_id=387a6ea6fa384a00a366d0d2071ba03a, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.495948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.514822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 779/1571] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:13 2022] PUT /identity/v3/projects/dcb20bac668247669420d2d5a0130b4e/users/387a6ea6fa384a00a366d0d2071ba03a/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:24:13.519017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.535813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6cbc-4fa1-48ff-b820-4716fd514b66 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.608884 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.609765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.610600 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.611181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.611981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.613974 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e21b9-de6b-4ced-925e-0a35c3b5d2c8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.630740 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 793/1572] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 19 02:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 02:24:13.634984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:13.646119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239397b5-a7d1-49c1-a891-a9dab476eb83 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:13.651563 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:13.652244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] REQUEST_METHOD: `PUT` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:13.652573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:13.652857 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] PATH_INFO: `/v3/projects/dcb20bac668247669420d2d5a0130b4e/users/387a6ea6fa384a00a366d0d2071ba03a/roles/5af3d5a7f1954ca192b73e15ec944747` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:13.654975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb20bac668247669420d2d5a0130b4e, user_id=387a6ea6fa384a00a366d0d2071ba03a, role_id=5af3d5a7f1954ca192b73e15ec944747)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:13.657705 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:13.672104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 780/1573] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 19 02:24:13 2022] PUT /identity/v3/projects/dcb20bac668247669420d2d5a0130b4e/users/387a6ea6fa384a00a366d0d2071ba03a/roles/5af3d5a7f1954ca192b73e15ec944747 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:24:18.656841 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf766f-ef6a-4cfe-be3c-3c10df793c11 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:18.657295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf766f-ef6a-4cfe-be3c-3c10df793c11 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:18.657295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf766f-ef6a-4cfe-be3c-3c10df793c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:18.724357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-debf766f-ef6a-4cfe-be3c-3c10df793c11 None None] MFA Rules not processed for user `b6778043d7984c4db2f045b3bfc83a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:18.730226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-debf766f-ef6a-4cfe-be3c-3c10df793c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:18.791312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:18.876479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 794/1574] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:18.892732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:18.898441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:19.009774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41e7a-0f0c-4995-b931-57d05287289b admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:19.014244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe513fdeb442c6bbd2e2144169ba78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:19.015010 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:19.016071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:19.016357 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:19.065561 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:19.117647 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:19.122065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:19.134214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 781/1575] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:19.814917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6eadd-251c-4c47-aab5-ae6752397cde None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:19.815433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6eadd-251c-4c47-aab5-ae6752397cde None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:19.815433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6eadd-251c-4c47-aab5-ae6752397cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:19.847719 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-52c6eadd-251c-4c47-aab5-ae6752397cde None None] MFA Rules not processed for user `387a6ea6fa384a00a366d0d2071ba03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:19.849636 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-52c6eadd-251c-4c47-aab5-ae6752397cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:19.964181 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 795/1576] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:19.972211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:19.975829 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:19.995276 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f41dd4-34f8-477b-8c7f-11816d938bde service glance] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:20.009397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe513fdeb442c6bbd2e2144169ba78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:20.010154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:20.010500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:20.010890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:20.134730 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:20.136179 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:20.153317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 782/1577] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:20.294940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b882c-38e2-4cd5-931f-f9ee8d8e7c26 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:20.295754 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b882c-38e2-4cd5-931f-f9ee8d8e7c26 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:20.296041 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b882c-38e2-4cd5-931f-f9ee8d8e7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:20.353257 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ec8b882c-38e2-4cd5-931f-f9ee8d8e7c26 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:20.354484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ec8b882c-38e2-4cd5-931f-f9ee8d8e7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:20.420775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 796/1578] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:20.490960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:20.492350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:20.585899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bfb37-0a21-4a73-9e54-8191252237bf service glance] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:20.591657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:20.592290 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:20.592573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:20.592850 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:20.602060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:20.604451 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:20.613957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 783/1579] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:24:20.905406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f480cd-54c8-4f2c-b331-692b1afb2b76 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:20.905933 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f480cd-54c8-4f2c-b331-692b1afb2b76 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:20.906017 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f480cd-54c8-4f2c-b331-692b1afb2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:20.941308 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b6f480cd-54c8-4f2c-b331-692b1afb2b76 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:20.943434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b6f480cd-54c8-4f2c-b331-692b1afb2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:20.954089 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 797/1580] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:20.969417 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:20.985861 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9773faf-b55d-43e4-84e8-69f307864e91 service swift] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:20.994918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:20.995818 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:20.996344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:20.996956 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:21.013282 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:21.015533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b8cf-bf5e-497d-8d6f-0c351e9d2c5e service swift] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:21.027361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 784/1581] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:24:30.274988 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999626aa-c67e-452a-bc9c-427a8f4687a6 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.275560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999626aa-c67e-452a-bc9c-427a8f4687a6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.275560 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999626aa-c67e-452a-bc9c-427a8f4687a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.294524 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-999626aa-c67e-452a-bc9c-427a8f4687a6 None None] MFA Rules not processed for user `7620799ff4574986a6a9819014b472be`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:30.295788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-999626aa-c67e-452a-bc9c-427a8f4687a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:30.303406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 798/1582] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:30.631461 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a13-221e-4d26-9e23-e10375d1336d None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.632702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a13-221e-4d26-9e23-e10375d1336d None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.633853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a13-221e-4d26-9e23-e10375d1336d None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.637928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 785/1583] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 19 02:24:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:30.644327 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a53a9-efc0-4135-bdd3-61d93c129f59 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.644611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a53a9-efc0-4135-bdd3-61d93c129f59 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.644892 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a53a9-efc0-4135-bdd3-61d93c129f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.681905 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:30.706871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f91a53a9-efc0-4135-bdd3-61d93c129f59 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:30.708111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f91a53a9-efc0-4135-bdd3-61d93c129f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:30.790686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 799/1584] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 19 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:30.795962 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc85b1-e1d0-46bc-bd3c-4a07940f6309 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.796353 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc85b1-e1d0-46bc-bd3c-4a07940f6309 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.796728 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc85b1-e1d0-46bc-bd3c-4a07940f6309 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.798305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 786/1585] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 19 02:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:30.803566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26f1a-e68f-425b-9300-bef8320271ad None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.804011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26f1a-e68f-425b-9300-bef8320271ad None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.804437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26f1a-e68f-425b-9300-bef8320271ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.830717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-abc26f1a-e68f-425b-9300-bef8320271ad None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:30.832199 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-abc26f1a-e68f-425b-9300-bef8320271ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:30.846749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 800/1586] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:30.855004 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc85b1-e1d0-46bc-bd3c-4a07940f6309 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:30.880425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc85b1-e1d0-46bc-bd3c-4a07940f6309 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:30.886293 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656434f6-4444-411e-b808-43b991d9933a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe513fdeb442c6bbd2e2144169ba78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:30.886999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434f6-4444-411e-b808-43b991d9933a service glance] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:30.887398 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434f6-4444-411e-b808-43b991d9933a service glance] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:30.887676 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434f6-4444-411e-b808-43b991d9933a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:30.918442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656434f6-4444-411e-b808-43b991d9933a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:30.920646 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656434f6-4444-411e-b808-43b991d9933a service glance] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:30.933807 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 787/1587] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:24:31.396950 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d4f-ecef-4f2b-a40c-965cbdd82391 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:31.402244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d4f-ecef-4f2b-a40c-965cbdd82391 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:31.402888 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d4f-ecef-4f2b-a40c-965cbdd82391 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:31.404786 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 801/1588] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 19 02:24:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:31.410952 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8973b-112b-4fa4-8c59-dfdd07369f3b None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:31.411238 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8973b-112b-4fa4-8c59-dfdd07369f3b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:31.411514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8973b-112b-4fa4-8c59-dfdd07369f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:31.445138 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=100 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:31.467605 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-29d8973b-112b-4fa4-8c59-dfdd07369f3b None None] MFA Rules not processed for user `52a425657bc44ce6b62595045bd5da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:31.468810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-29d8973b-112b-4fa4-8c59-dfdd07369f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:31.530415 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 788/1589] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:31.537165 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461d4f-ecef-4f2b-a40c-965cbdd82391 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:31.556436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461d4f-ecef-4f2b-a40c-965cbdd82391 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:31.561672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:31.562553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:31.562867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:31.563146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:31.574682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:31.576202 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da4326-2acb-4c53-b077-7076c94d1c8f service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:31.586687 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 802/1590] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:32.058862 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782bf7c-da75-4b74-90e8-24d2e41b3d06 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.059304 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782bf7c-da75-4b74-90e8-24d2e41b3d06 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.059393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782bf7c-da75-4b74-90e8-24d2e41b3d06 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.061504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 789/1591] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 19 02:24:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:32.068462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb904-ca7b-44e8-8f67-c98745486d25 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.068898 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb904-ca7b-44e8-8f67-c98745486d25 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.069886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fb904-ca7b-44e8-8f67-c98745486d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.095527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-934fb904-ca7b-44e8-8f67-c98745486d25 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:32.097820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-934fb904-ca7b-44e8-8f67-c98745486d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:32.099808 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bbaa-fd8e-4e12-ab46-8af8e3bfe9db None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.100147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bbaa-fd8e-4e12-ab46-8af8e3bfe9db None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.100420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506bbaa-fd8e-4e12-ab46-8af8e3bfe9db None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.101765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 790/1592] 10.222.0.45 () {54 vars in 961 bytes} [Fri Aug 19 02:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:32.121000 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e463bad-4d93-42eb-ac90-29688cb99312 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.121286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e463bad-4d93-42eb-ac90-29688cb99312 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.121566 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e463bad-4d93-42eb-ac90-29688cb99312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.127162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 803/1593] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 19 02:24:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:32.132277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208b667-7c51-4f07-8987-199c3a741e14 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.133607 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208b667-7c51-4f07-8987-199c3a741e14 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.134361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208b667-7c51-4f07-8987-199c3a741e14 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.141052 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 804/1594] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 19 02:24:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:32.150262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb866a0-a607-418d-854e-60d971832739 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.150553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb866a0-a607-418d-854e-60d971832739 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.150867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb866a0-a607-418d-854e-60d971832739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.151315 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3e463bad-4d93-42eb-ac90-29688cb99312 None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:32.152547 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3e463bad-4d93-42eb-ac90-29688cb99312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:32.176717 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cbb866a0-a607-418d-854e-60d971832739 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:32.178227 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cbb866a0-a607-418d-854e-60d971832739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:32.198129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 805/1595] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:32.204972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb866a0-a607-418d-854e-60d971832739 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:32.214732 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb866a0-a607-418d-854e-60d971832739 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:32.218867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:32.219486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.219772 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.220028 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.231514 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:32.232949 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:32.244439 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 806/1596] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 02:24:32.250955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 791/1597] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Aug 19 02:24:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:32.259621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:32.271275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34113b-fffa-4812-abdc-159c45e317fb service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:32.276885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:32.277650 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:32.277936 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:32.278225 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:32.280043 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:32.292999 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:32.295097 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:32.306527 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 807/1598] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:34.037608 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16dd0-03e9-4afc-b3c1-7f46ff225d54 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:34.038074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16dd0-03e9-4afc-b3c1-7f46ff225d54 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:34.038191 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16dd0-03e9-4afc-b3c1-7f46ff225d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:34.058144 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-63a16dd0-03e9-4afc-b3c1-7f46ff225d54 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:34.059378 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-63a16dd0-03e9-4afc-b3c1-7f46ff225d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:34.066721 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 792/1599] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:34.079091 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:34.090648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2210-7467-4a24-a3b8-7c239bcddb5b service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:34.095682 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:34.096531 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:34.096812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:34.097087 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:34.105880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:34.107564 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:34.117023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 808/1600] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:24:42.479978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6427a1-29e5-47f6-a297-51479aec0092 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:42.479978 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6427a1-29e5-47f6-a297-51479aec0092 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:42.480444 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6427a1-29e5-47f6-a297-51479aec0092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:42.500909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-af6427a1-29e5-47f6-a297-51479aec0092 None None] MFA Rules not processed for user `52a425657bc44ce6b62595045bd5da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:42.502154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-af6427a1-29e5-47f6-a297-51479aec0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:42.509673 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 793/1601] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Aug 19 02:24:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:24:42.523011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:42.532985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec08b-8d76-4435-a393-929f20c7096f service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:42.536599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:42.537203 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:42.537484 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:42.537760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:42.545453 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:42.546957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6592b-0090-4d51-be5e-92db75b3dd0f service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:42.554599 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 809/1602] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:43.264137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19857-3a71-46d8-a709-7d57cd223cb1 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:43.264430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19857-3a71-46d8-a709-7d57cd223cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:43.264797 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad19857-3a71-46d8-a709-7d57cd223cb1 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:43.267777 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 794/1603] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:43.318518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1019f-e1b5-4736-9342-d5d8cc3d4f0c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:43.318957 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1019f-e1b5-4736-9342-d5d8cc3d4f0c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:43.319267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1019f-e1b5-4736-9342-d5d8cc3d4f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:43.343038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d4c1019f-e1b5-4736-9342-d5d8cc3d4f0c None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:43.344702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4c1019f-e1b5-4736-9342-d5d8cc3d4f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:43.355931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 810/1604] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:24:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:43.374611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19857-3a71-46d8-a709-7d57cd223cb1 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:43.391114 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad19857-3a71-46d8-a709-7d57cd223cb1 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:43.400078 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:43.401977 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:43.402464 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:43.403618 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:43.413346 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:43.415177 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84f0b-1f6d-44e5-b3d7-56833af47679 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:43.425812 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 795/1605] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:49.891278 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97fc80-669f-4c6c-8376-93566a836685 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:49.891855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97fc80-669f-4c6c-8376-93566a836685 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:49.891855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97fc80-669f-4c6c-8376-93566a836685 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:49.893168 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 811/1606] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:24:49.905454 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:49.905973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:49.905973 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:49.928233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:24:49.929426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:24:49.938601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 796/1607] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:24:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:24:49.952532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97fc80-669f-4c6c-8376-93566a836685 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:24:49.970367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97fc80-669f-4c6c-8376-93566a836685 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:24:49.975975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:24:49.976573 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:24:49.977466 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:24:49.977741 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:24:49.986420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:24:49.988023 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c7039-1cb7-42f6-ae68-bf5a8e2831b8 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:24:49.998046 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 812/1608] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:24:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:24:59.923803 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=68 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:24:59.993925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=80 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:08.613341 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:25:08.622953 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169f2b-34c4-47a8-ad35-7d6e9e18c143 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:25:08.626463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:25:08.627085 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:08.627390 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:08.627659 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:08.636258 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:25:08.637672 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc404-628b-4fa5-bb0a-0b09d03eda48 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:25:08.646928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 797/1609] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:25:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:25:17.017430 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8718b-b3f2-40f3-aa35-1576d9ffd69c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:17.017932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8718b-b3f2-40f3-aa35-1576d9ffd69c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:17.017932 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8718b-b3f2-40f3-aa35-1576d9ffd69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:17.036104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5af8718b-b3f2-40f3-aa35-1576d9ffd69c None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:17.037279 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5af8718b-b3f2-40f3-aa35-1576d9ffd69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:17.044785 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 813/1610] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:25:18.642726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=6 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:27.031545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:25:59.101735 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:25:59.102273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:25:59.102367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:25:59.121938 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:25:59.123170 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:25:59.129919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 798/1611] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:25:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:26:09.117375 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:15.771611 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415240c-aa29-409c-923c-4e087a77b7b3 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.772098 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415240c-aa29-409c-923c-4e087a77b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.772180 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415240c-aa29-409c-923c-4e087a77b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.791880 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e415240c-aa29-409c-923c-4e087a77b7b3 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:15.793075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e415240c-aa29-409c-923c-4e087a77b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:15.800156 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 814/1612] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:26:15.840906 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:15.853344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c74e3-b73a-456c-8db1-6e67e11990ce None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:15.858302 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:15.858951 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:15.859230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:15.859505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:15.867387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:15.868995 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4240b6-361d-454a-8df7-6468314b9974 service swift] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:15.876924 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 799/1613] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:26:19.192877 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.193317 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.193412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.212742 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.213923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.220655 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 815/1614] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:26:19.516855 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bdaf-f477-4e50-a296-0a300572d506 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.517350 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bdaf-f477-4e50-a296-0a300572d506 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.517442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bdaf-f477-4e50-a296-0a300572d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.536058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-d0e0bdaf-f477-4e50-a296-0a300572d506 None None] MFA Rules not processed for user `52a425657bc44ce6b62595045bd5da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:19.537251 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d0e0bdaf-f477-4e50-a296-0a300572d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:19.543612 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 800/1615] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:26:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:26:19.554686 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:19.564450 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa36b-9d11-4045-a319-2fd66387a8ae None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:19.567907 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:19.568495 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:19.568771 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:19.569038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:19.576394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:19.577798 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:19.585463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 816/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:26:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:26:29.531505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=9 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:29.582287 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=12 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:47.510039 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953465f-6f50-4b5b-acbd-77f3ee26a1c1 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.510948 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953465f-6f50-4b5b-acbd-77f3ee26a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.511385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953465f-6f50-4b5b-acbd-77f3ee26a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.532277 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8953465f-6f50-4b5b-acbd-77f3ee26a1c1 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:26:47.533544 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8953465f-6f50-4b5b-acbd-77f3ee26a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:26:47.540859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 801/1617] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 19 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:26:47.555022 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:26:47.567984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6433aa-4421-4e05-b96e-f1fbd860466c service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:26:47.573516 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:26:47.574143 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:26:47.574426 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:26:47.574737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:26:47.583621 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:26:47.585228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:26:47.594756 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 817/1618] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 02:26:57.526555 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:26:57.590703 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=6 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:04.113963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6443e-7265-436b-8dba-304dd27ae786 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:04.114463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6443e-7265-436b-8dba-304dd27ae786 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:04.114553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6443e-7265-436b-8dba-304dd27ae786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:04.133270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-cad6443e-7265-436b-8dba-304dd27ae786 None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:04.134452 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-cad6443e-7265-436b-8dba-304dd27ae786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:04.141208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 802/1619] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:27:14.129264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=3 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:19.049076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:19.058086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b1ae-ac05-4d58-af84-38bbe66251db service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:19.061609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:19.062205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:19.062490 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:19.062793 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:19.072132 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:19.073545 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55947740-1365-4d83-acca-5b001f16b4e8 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:19.082746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 818/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:27:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:27:21.058222 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddb9-6faa-4ec0-b0e0-774f4b7d5a98 None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.058882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddb9-6faa-4ec0-b0e0-774f4b7d5a98 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.058882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddb9-6faa-4ec0-b0e0-774f4b7d5a98 None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.060755 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 803/1621] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:27:21.065633 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.066060 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.066231 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.085505 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] MFA Rules not processed for user `c3d216824c7946abb79dd7c65cfd1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:27:21.086746 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:27:21.096099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 819/1622] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:27:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:27:21.108442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5ddb9-6faa-4ec0-b0e0-774f4b7d5a98 None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:21.123726 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5ddb9-6faa-4ec0-b0e0-774f4b7d5a98 None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:21.129071 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:21.129667 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:21.129940 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:21.130209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:21.138828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:21.140400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac4837-c19c-41dc-8dc8-8dbdda429379 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:21.151001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 804/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:27:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:27:31.080660 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=9 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:31.146463 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=6 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:27:31.853288 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:27:31.864776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848f151-ada6-4665-ad7b-98ed36c7eae8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:27:31.869707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:27:31.870305 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:27:31.870609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:27:31.870885 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:27:31.878947 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:27:31.881093 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:27:31.890536 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 820/1624] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:27:41.886634 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=6 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:26.814750 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740c84-f63b-4394-9b88-4210c182903e None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:26.815260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740c84-f63b-4394-9b88-4210c182903e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:26.815365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740c84-f63b-4394-9b88-4210c182903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:26.834212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-7a740c84-f63b-4394-9b88-4210c182903e None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:26.835438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-7a740c84-f63b-4394-9b88-4210c182903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:26.843088 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 805/1625] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 19 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:28:26.887990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:26.899032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beeb29-1f9d-4f23-b4d2-f6cdb7103b5f service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:26.904878 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:26.905494 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:26.905776 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:26.906051 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:26.913824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:26.915502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:26.923262 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 821/1626] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:28:27.370146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681e885-2c7e-4f00-adba-f91373d19657 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:27.370967 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681e885-2c7e-4f00-adba-f91373d19657 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:27.371240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681e885-2c7e-4f00-adba-f91373d19657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:27.390358 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-5681e885-2c7e-4f00-adba-f91373d19657 None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:27.391576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5681e885-2c7e-4f00-adba-f91373d19657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:27.398993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 806/1627] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:28:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:28:27.411055 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:27.421119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c706-7110-4133-81fe-61564f617c61 service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:27.425993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:27.426588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:27.426894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:27.427171 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:27.435820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:27.437365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51597-4658-4f0b-808e-10c4afbd1380 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:27.445359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 822/1628] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:28:35.651811 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:35.652319 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:35.652409 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:35.671944 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] MFA Rules not processed for user `7620799ff4574986a6a9819014b472be`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:35.673147 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:35.679990 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 807/1629] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:28:37.442204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=12 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:37.451228 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:37.451518 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:37.451799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:37.472465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:28:37.473804 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:28:37.481334 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 823/1630] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 19 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 02:28:37.494100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:28:37.506142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd039c9-dcee-4b28-99b5-d213e42daa8f None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:28:37.512001 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:28:37.513233 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:28:37.513517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:28:37.513789 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:28:37.522335 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:28:37.524280 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba857d0-d736-4936-bdaa-083c9b068c31 service swift] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:28:37.533338 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 808/1631] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:28:47.465853 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:28:47.529799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=15 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:19.941159 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:19.953586 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a12b7-45b7-4747-b3a4-74311142e1ea None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:19.959208 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:19.959813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:19.960095 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:19.960367 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:19.968146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:19.969736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:19.979112 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 824/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:29:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:29:22.327960 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:22.328511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:22.328511 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:22.350644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:29:22.351875 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:29:22.362925 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 809/1633] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:29:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:29:29.595822 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:29.608068 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811ae3-d417-4f4c-aa1d-ad365048bdd6 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:29.613488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:29.614111 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:29.614393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:29.614707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:29.622137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:29.623734 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:29.632344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 825/1634] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:29:31.193578 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:31.203433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc3853-edf9-42ff-bcd9-3e53d8759b9e None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:31.207844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:31.208481 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:31.208760 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:31.209032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:31.219532 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:31.221420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:31.236736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 810/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:29:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:29:32.244412 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:29:32.253372 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508004b-72f5-4588-a161-238e2ec2135d service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:29:32.256935 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:29:32.257530 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:29:32.257814 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:29:32.258090 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:29:32.267904 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:29:32.269337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:29:32.279695 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 826/1636] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:29:41.231894 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=9 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:29:42.275337 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=18 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:15.448645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:15.460707 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d384e-7f98-433d-b6c8-f7d7ad528453 service neutron] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:15.465913 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:15.467336 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:15.467838 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:15.468214 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:15.477678 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:15.480014 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68315be0-e4cd-49a8-a41e-97b7209681ff service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:15.490879 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 811/1637] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:30:21.537303 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:21.550989 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8b67-2514-40db-8511-2f9a9cd36c48 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:21.557042 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:21.557648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:21.557929 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:21.558314 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:21.569553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:21.571424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:21.583175 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 827/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:30:22.709761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:22.710264 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:22.710359 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:22.729425 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] MFA Rules not processed for user `c93e1c97e34048c3a49742d523b7eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:30:22.730648 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:22.737823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 812/1639] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 19 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:30:22.778440 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:22.790609 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea2cf-2c86-4a51-bb1c-6183115c3b35 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:22.795543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4349bca8444e65a321cf2bf2572ded', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:22.796142 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:22.796424 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:22.796702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:22.805283 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:22.806867 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b656f05-526d-4c22-857a-2cd21b6cd8d9 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:22.814675 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 828/1640] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 19 02:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 02:30:23.168479 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:23.177589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911238-362b-4d9e-91de-37bc0f36799a None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:23.181162 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:23.182146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:23.182146 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:23.182309 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:23.242242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:23.243711 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f53a6-e6d8-41b6-9c2f-6359e52764f2 service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:23.252918 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 813/1641] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:30:26.413859 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bf1-acac-4e2e-a1c3-59afd6fb5233 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:26.414733 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bf1-acac-4e2e-a1c3-59afd6fb5233 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:26.415502 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bf1-acac-4e2e-a1c3-59afd6fb5233 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:26.416902 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 829/1642] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:30:26.433553 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ceff2-280b-44fe-863d-ac762e4ca7a7 None None] REQUEST_METHOD: `POST` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:26.434080 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ceff2-280b-44fe-863d-ac762e4ca7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:26.434344 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ceff2-280b-44fe-863d-ac762e4ca7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:26.455219 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.auth.core [None req-e69ceff2-280b-44fe-863d-ac762e4ca7a7 None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81528) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:30:26.456420 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-e69ceff2-280b-44fe-863d-ac762e4ca7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:26.465519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 814/1643] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:30:26.477127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75bf1-acac-4e2e-a1c3-59afd6fb5233 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:26.493663 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75bf1-acac-4e2e-a1c3-59afd6fb5233 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:26.498965 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:26.499639 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:26.499928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:26.500211 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:26.510992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:26.512774 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceb9bc-510e-46cf-a54d-92e1126d5e57 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:26.534729 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 830/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:30:29.731312 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0cbaa-0ed9-4c98-b8e5-223225a7231b None None] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:29.731737 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0cbaa-0ed9-4c98-b8e5-223225a7231b None None] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:29.731928 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0cbaa-0ed9-4c98-b8e5-223225a7231b None None] PATH_INFO: `/` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:29.733757 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 815/1645] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 19 02:30:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 02:30:29.741837 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:29.742301 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:29.742397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:29.766459 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] MFA Rules not processed for user `a8f688eefaca493eab31cacad26e6548`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:30:29.767796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:29.778157 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 831/1646] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 19 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:30:29.792984 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0cbaa-0ed9-4c98-b8e5-223225a7231b None None] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:29.812441 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0cbaa-0ed9-4c98-b8e5-223225a7231b None None] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:29.816985 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:29.819436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:29.820226 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:29.820508 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:29.820783 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:29.829243 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf1cf-60c8-4f3a-bfea-a0b99eb9414b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:29.830689 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:29.833912 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:29.834032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:29.835307 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:29.835588 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:29.835858 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] PATH_INFO: `/v3/users/7620799ff4574986a6a9819014b472be` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:29.836975 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7620799ff4574986a6a9819014b472be)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:29.837971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: WARNING py.warnings [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:30:29.837971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: warnings.warn(msg) Aug 19 02:30:29.837971 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: Aug 19 02:30:29.839273 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:29.844512 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 816/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:30:29.905137 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7620799ff4574986a6a9819014b472be'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:29.912244 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7620799ff4574986a6a9819014b472be'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:29.912871 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7620799ff4574986a6a9819014b472be'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:29.913492 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7620799ff4574986a6a9819014b472be'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:29.923641 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7620799ff4574986a6a9819014b472be'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:29.947795 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 832/1648] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 19 02:30:29 2022] DELETE /identity/v3/users/7620799ff4574986a6a9819014b472be => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 02:30:30.120805 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:30.135388 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126ab98-1dd9-4e14-9be5-437c70469485 service placement] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:30.201468 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:30.202102 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:30.202381 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:30.202694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] PATH_INFO: `/v3/projects/ab44209aebd34f57b24977b2b2559e15` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:30.203810 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab44209aebd34f57b24977b2b2559e15)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:30.204860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: WARNING py.warnings [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 02:30:30.204860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: warnings.warn(msg) Aug 19 02:30:30.204860 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: Aug 19 02:30:30.206048 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:30.261488 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab44209aebd34f57b24977b2b2559e15', 'request_id': 'req-667bbd13-7094-4fee-84dd-17f15a05f40f'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.274397 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab44209aebd34f57b24977b2b2559e15', 'request_id': 'req-667bbd13-7094-4fee-84dd-17f15a05f40f'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.276964 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:30.282204 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab44209aebd34f57b24977b2b2559e15', 'request_id': 'req-667bbd13-7094-4fee-84dd-17f15a05f40f'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.294724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] The token cache is being invalidate because project ab44209aebd34f57b24977b2b2559e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81528) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:30:30.295011 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.295627 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.297118 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 817/1649] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 19 02:30:30 2022] DELETE /identity/v3/projects/ab44209aebd34f57b24977b2b2559e15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:30:30.301270 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:30.302706 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:30.316086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe202aef-5cdc-4033-8ef8-0976cfd2b019 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:30.372123 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:30.372765 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:30.373047 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:30.373325 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] PATH_INFO: `/v3/users/387a6ea6fa384a00a366d0d2071ba03a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:30.374462 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387a6ea6fa384a00a366d0d2071ba03a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:30.376486 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:30.403961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:30.422796 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387a6ea6fa384a00a366d0d2071ba03a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.430496 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387a6ea6fa384a00a366d0d2071ba03a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.431129 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387a6ea6fa384a00a366d0d2071ba03a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.431727 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387a6ea6fa384a00a366d0d2071ba03a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.438400 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2306a19a-cc58-42cb-b702-41a3c94e0a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387a6ea6fa384a00a366d0d2071ba03a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.454779 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 833/1650] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 19 02:30:30 2022] DELETE /identity/v3/users/387a6ea6fa384a00a366d0d2071ba03a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:30:30.623349 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:30:30.624900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:30:30.637992 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bbd13-7094-4fee-84dd-17f15a05f40f admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:30:30.696844 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:30:30.697480 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:30:30.697762 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:30:30.698064 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] PATH_INFO: `/v3/projects/dcb20bac668247669420d2d5a0130b4e` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:30:30.699212 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb20bac668247669420d2d5a0130b4e)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:30:30.701119 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:30:30.746406 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb20bac668247669420d2d5a0130b4e', 'request_id': 'req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.752361 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb20bac668247669420d2d5a0130b4e', 'request_id': 'req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.759499 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb20bac668247669420d2d5a0130b4e', 'request_id': 'req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.769562 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] The token cache is being invalidate because project dcb20bac668247669420d2d5a0130b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81528) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:30:30.769848 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.770475 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:30:30.772517 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 818/1651] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 19 02:30:30 2022] DELETE /identity/v3/projects/dcb20bac668247669420d2d5a0130b4e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:30:40.451404 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:30:40.766645 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:25.783764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:25.784267 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:25.784365 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:25.802763 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] MFA Rules not processed for user `cd34454ce1de45feb4e0c18830babf58`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 02:31:25.803961 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:25.857033 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 834/1652] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 19 02:31:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 02:31:26.174909 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:26.176540 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:26.232966 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6d09-2669-45fa-b7b3-7c96914b4e9d admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:26.236551 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:26.237152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:26.237433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:26.237710 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:26.239437 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:26.249127 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:26.250556 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:26.258161 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 819/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:26.687092 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:26.688433 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:26.757882 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655da64-fbc9-4176-9ca9-c3419c62fccc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:26.763103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:26.763724 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:26.764008 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:26.764286 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:26.766038 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:26.777654 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:26.779323 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:26.788799 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 835/1654] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:36.254828 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=26 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:36.784886 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=57 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:31:38.000076 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:31:38.001592 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:38.077387 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749acd96-7950-4d2b-acdc-7c1d21437f2c service neutron] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:31:38.083086 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:31:38.083694 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:31:38.083972 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:31:38.084242 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:31:38.085915 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:31:38.097576 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:31:38.099187 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:31:38.110032 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 820/1655] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:31:48.105099 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=34 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:32:35.792394 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:32:35.793775 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:35.875065 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6016454-5d60-47db-b208-93adcf664bf1 service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:32:35.880074 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:32:35.880670 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:32:35.880955 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:32:35.881230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:32:35.882963 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:32:35.894232 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:32:35.895836 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:32:35.905780 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 836/1656] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:32:45.901376 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=37 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:10.943931 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:10.945665 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:11.047133 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b9ef-661b-4dda-be9d-c61ef8ea82ed service nova] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:11.054630 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d216824c7946abb79dd7c65cfd1ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:11.055295 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:11.055690 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:11.055900 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:11.057993 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:11.076917 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:11.079240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:11.092601 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 821/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:21.088104 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=40 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:23.190438 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:23.208927 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11a4e3-96d3-4e99-8efe-4e2984f7fab5 service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:23.214657 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a425657bc44ce6b62595045bd5da1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:23.215260 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:23.215538 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:23.215813 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:23.217519 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:23.307414 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:23.308890 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:23.328434 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 837/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:33:29.438833 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:29.440311 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:29.453736 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424df4-369a-4e4c-8ac8-d77b235feaf4 service nova] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:29.458407 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:29.459103 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:29.459393 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:29.459697 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] PATH_INFO: `/v3/users/cd34454ce1de45feb4e0c18830babf58` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:29.460819 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd34454ce1de45feb4e0c18830babf58)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:29.462823 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:29.510806 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd34454ce1de45feb4e0c18830babf58'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.518205 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd34454ce1de45feb4e0c18830babf58'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.518854 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd34454ce1de45feb4e0c18830babf58'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.519465 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd34454ce1de45feb4e0c18830babf58'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.526215 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd34454ce1de45feb4e0c18830babf58'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.543543 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 822/1659] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 19 02:33:29 2022] DELETE /identity/v3/users/cd34454ce1de45feb4e0c18830babf58 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:33:29.711908 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:29.723058 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08173-c164-4b27-b0a6-0c04452836c9 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:29.789749 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:29.790385 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:29.790702 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:29.790986 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] PATH_INFO: `/v3/projects/2796e836399045c18eff2a7ca9bee757` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:29.792106 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2796e836399045c18eff2a7ca9bee757)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:29.794009 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:29.840209 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2796e836399045c18eff2a7ca9bee757', 'request_id': 'req-f2135ce8-e14a-449d-855e-69faca299c32'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.847824 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2796e836399045c18eff2a7ca9bee757', 'request_id': 'req-f2135ce8-e14a-449d-855e-69faca299c32'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.849764 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:29.854457 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2796e836399045c18eff2a7ca9bee757', 'request_id': 'req-f2135ce8-e14a-449d-855e-69faca299c32'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.867832 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] The token cache is being invalidate because project 2796e836399045c18eff2a7ca9bee757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:33:29.868117 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.868761 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:29.870644 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 838/1660] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 19 02:33:29 2022] DELETE /identity/v3/projects/2796e836399045c18eff2a7ca9bee757 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:33:29.874919 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:29.876395 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:29.890155 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e367-a4b0-4486-a68d-dc0aab749107 admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:29.949263 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:29.949887 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:29.950164 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:29.950436 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] PATH_INFO: `/v3/users/b6778043d7984c4db2f045b3bfc83a7a` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:29.951571 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6778043d7984c4db2f045b3bfc83a7a)` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:29.954018 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:29.999820 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6778043d7984c4db2f045b3bfc83a7a'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.006923 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6778043d7984c4db2f045b3bfc83a7a'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.007614 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6778043d7984c4db2f045b3bfc83a7a'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.008249 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6778043d7984c4db2f045b3bfc83a7a'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.015150 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.notifications [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6778043d7984c4db2f045b3bfc83a7a'} {{(pid=81528) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.023322 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:30.035075 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 823/1661] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 19 02:33:29 2022] DELETE /identity/v3/users/b6778043d7984c4db2f045b3bfc83a7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:33:30.207788 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:33:30.209246 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:33:30.221533 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2135ce8-e14a-449d-855e-69faca299c32 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:33:30.278275 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e755f06a714e6f8be16f18f3592f97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4794a120bdce4ac9a7db206c3d083bb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:33:30.278872 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:33:30.279152 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:33:30.279429 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] PATH_INFO: `/v3/projects/c9707f12e109481094295fdf98a37b4e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:33:30.280698 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9707f12e109481094295fdf98a37b4e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:33:30.282656 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:33:30.326240 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9707f12e109481094295fdf98a37b4e', 'request_id': 'req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.333643 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9707f12e109481094295fdf98a37b4e', 'request_id': 'req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.339053 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9707f12e109481094295fdf98a37b4e', 'request_id': 'req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.349839 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] The token cache is being invalidate because project c9707f12e109481094295fdf98a37b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 02:33:30.350230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.351100 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d11c361f-fa24-49b0-be19-5dcca9d6b2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 02:33:30.352589 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 839/1662] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 19 02:33:30 2022] DELETE /identity/v3/projects/c9707f12e109481094295fdf98a37b4e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 02:33:40.032158 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:33:40.347005 dv-osbrick-853457-2-iscsi devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=56,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 02:37:42.794096 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Authenticating user token {{(pid=81528) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 02:37:42.795504 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:42.862981 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cdd6-009f-4256-831c-de7c0dce701c admin admin] Validating token access rules against request {{(pid=81528) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 02:37:42.920294 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f688eefaca493eab31cacad26e6548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033977d6eb2040e493bb4b576bb3af6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81528) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 02:37:42.920899 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] REQUEST_METHOD: `GET` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 02:37:42.921174 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] SCRIPT_NAME: `/identity` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 02:37:42.921442 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81528) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 02:37:42.923154 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.fernet_utils [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81528) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 02:37:42.933623 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 02:37:42.935230 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb3ec-7d55-44a4-8633-d731f2197a90 service placement] RBAC: Authorization granted {{(pid=81528) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 02:37:42.944500 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: [pid: 81528|app: 0|req: 824/1663] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 19 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 02:37:52.940596 dv-osbrick-853457-2-iscsi devstack@keystone.service[81528]: DEBUG dbcounter [-] [81528] Writing DB stats keystone:SELECT=58 {{(pid=81528) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}